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INTRODUCTION 



This report describes the attitudinai responses to the various.. > 

learning. activilies, the defivery system, and the equipment that wefe 

obtained from. students whe t^pok a course" in career educatioh during the^ 

summer of 1974. The course was entitled Career. Education in the Elementary 

School (CEE) and wa>s produced t^y the Appalachian Education Satellite 

Project (AESP) for television broadcast via satell.ite to sites across trie 

Appalachian region. ' " v " . 

W Appalachian ,Ecfucat\on Satellite^roject began in June 1973 ^ 

with a grant from the I^Qi)al ^nst^tute of Educaljion^ (NIE) to the^ . 
AppalacJrian Regional Commission (ARC). The purpose of the project was„to ' 
demonstrate >Ke feasibility of "conducting graduate leve> courses for 
teachers <ising sophisticated National Aeronautics and Space Administration 
(NASA) c^unjcatipns satellites. .The four courses developed for the 
project were in the areas of career education and reading instruction. 
All software for the .courses ^was de.veloped at the Resource Co«\rdinating- 
Center (RCC) located o'n the campus of the' University of Kentucky in 
Lexington, "Kentucky. . ' , 

. A total of f6i^r courses, two in reading and two iri' career education 
were scheduled 'to be c^ducted via satellite between June 1974 and June 1975. 
The course participants were" approximately 1200 .teachers (300 per course) 
gathered at Sassrootii sites"at 15 different locations in the Appalachian^' 
region. The sjitesT^re located, in, eight different sHates from, Alabama ^ to 



' r 



>^New York anct were- grouped into setsi'bf th-ree, a main sjlte and two * L> . 
ancillary^sites. * Main sites were able t6;receive audio and video signals 
transmitt§fd f rom^he RCC via the/ ATS-6if?atell ite and could »recei ye and 

*send Voite or. teletype -signals to or from the RCC and other main sites ^ia 



the At®-3 satellite. Ancillary sites^ could Receive ^aucjio anc| video signals 
transmitted from the RCC via ATS-6-and were in telephone ^^ommuni cat ic^ ' 
with the associated mafn site^ -An-cillary sites coitld not rjecei ye or 'trans.- 
mit^via ATS-3. ^ All -suites were equip<|)ed wiih a col«)r^ televtJion. monitor 
and had adequate seating for ^20 students. TheMoCations of the 15» s4tes ' 
are illustrated in Figure 1. ^. . ;^ /^ 
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' The monitoring of classroom sites and ma^ny other -project re'lated- 
/t^sks cbnducted at the Ijocalllevel were the responsibility of project staff 
members called si tejs^jmx^ employed at participating^ Regional ; 

.Education Service Agencies (RESAs)''aff il iated with the ARC. A full . 
description of the duties of the site Coordinator can be found' in AESP > 
Technical Report (Ausness and Bowling, 1974j. ' ^ 

The "Career Education ^n the Elementary. School (CEE)'^ourse was 
conducted using the two NASA satellites during the summer of IW. The 
course was designed so that, high quality instruction and the opportunity^ ^ 
for' student interaction With content ext^erts was possible. It was not 
ne^€sary for an expert in career education instruction ;to be on-site 
during class meetings. The cdurse consisted of twelve, thirty-minut'e, 
color videotaped lessons; twelve associated audio rfeview segments (one. 
for each 'videotaped lesson) , laboratory cicrtivi^ies , unit'tests, and related 
reading^materials; an* four forty-five minute, ;1 ive, interactive (dDlor) - 
seminar programs. ^: ; / ' ^ ''^ ^ ' : 



FIG. 1 MAP OF THE APPALACHIAN REGION 
SHOWING THE FIVE RESA CLUSTERS, RECEIVING 
TRIANGLES, -AND APPROXIMATE SATELLITE FOOT 
PRINT. 



A. Fredonia, NVY. I. Boone, N.C. 

B. Olean, N.Y. J. tTohnson *C.ity, Tenn'. 

C. Edinboro, Pa. ^ K*! LaFoJLlette, Tenn. 

D. Cumberland, Md, 'L. Coalfield, Tenn. 

E . MeHenry , Md . - ' M . Huntsvi lie , Ala .' 
'F. Keyser, W. Va. _ - N. Rainsville, Ala. 

G. Norton, Va. ^ > 0. ' Guntersville^ Ala. - 

H. Stioklyville, Va. 



The course was designed to be a survey af major principles, 

concepts, and practices of career education in the elementary sc^hool 

' ^ • ' - . <, " 

Experiences were offered the participants which enabled them to develop 

•. , • ^ • ' • - ^ 
career education "units y/hjch could Jj'e infused Into their'acldemic subj-ect 

^areas at the appropriate grade levels. As a result of this course, each 
participant was also to be able to inform the school staff of the need ^pr 

•career education and to serve as a leader in planning and implementing 
a career education program in classroom, school, or. school system. 

The CEE course was developed by a team of AiSP personnel. The 
production team included ProdOcer-Director Peter Gillette and^conteht 

'persons Dr. David Larimore, Dr. Noff'?et Williams, Dr. Raymond Manion, 

Betty Bowling, Timotby p'asden. Dr. Fran^ Col ton,- Mary Clark'son, Roger. 

Koonce, Bernie Lovely, .Alice Martinson; Barbara Prel i and -Cathy Whitton. / 

Every effort wa-s made "within the timeframe of the productioo schedule 

to involve teachers, administrators, and other school personnel as well 

as cooperating faculty at-'various universities and colleges; in the., 

Appalachian rkgion in the planning anfl development of the course. 'The 

goal was to make the course particularly responsive to the needs and. 

interests of teachers ir?*'*the region. Gr^aduate credit was available" to the 

, ■ • -1^ - 

qourse participants at the Universe" ty of Kentucky and at a nutfiber of 

cooperating universities in the region. 

The thirty -minute, videotaped lessons can be de/cribed as studio- 
based lecture presentations by the course instructor, supported by graphi/s 
and. filmed materials— iJicluding classroom scenes and interviews- with 
• various professional s in the field of career education. A course outline, 
is included in 'Appendix A, Item A. 



Audio review segments consisted of four or five four-alternative 
multjple choice questions'. As each 'question was presented the student^ , 

selected one of t?he four audio tracks corresponding to what he believed 

> ' ■ * ■ . ■( ' 

the (jorrect answer to be. Afi explanation of the correctness or in- 

.correctnes's of the answer was contained on the track selected b^ the 

student. The questions were selected to reinforce and ^^^(pand upon the 

material presented in the videotaped . lectur^. - Because thejre were four 

tracks and the series of questions was presented in rigid serial order 

the activity was similar to programmed instruction in that branching 

within questions was possible. However, branching between questions was, 

not possible. Special equipment for the four chann-el audio instruction, 

including the student response selectors and electronic equipment for 

automatically recording answers, is described in AESP Technical Report #5 

(Bramble, Ausness,-^ndjreeman, 1975). 

'The live, i;jterac:f've seminars were structured in the following 

way. Dr. David\arimore of the University of ' Kentucky served as a . 

moderator for a panel of pj:ofessional s who were experts in the area of 

focus for that particular seminar. Questions afiout.the subject matter 

of the course were transmitted from the main classroom sites to the - 

•Lexington, Kentucky studio via teletype transmission using ATS-3. Thus 

the 'questions were immediately available at the studio in written form. 

Questions frofn ancillary sites were teletyped via conventional telephone 

■ ■ V. > , 

lines to the associated main site and then transmitted to Lexington. 
Questions were screened in the sUtidio to minimize redundancy and passed 
to the seminar moderator to be posed to the guests. Questions were 
identified by classro(^ site as they were readier the air. ^ 



• ■ . 6 : . ' ■ 

The laboratory activities were conducted during each class session 
upon completion of the television and, audio revifw activities. Their* 
)urpose was^to expand upon points made in the proceeding activities. '( 
Readings, game activities, and discussion groups vere prominent techniques 
used in thesis sessions. Laboratory sessions also incJuded instruction In 
the^use of the various informatior^ systems made available to* course parti- 
cipants. Appendix A, Item B cor^tajns.a sutnmary of the laboratQry activities 
conducted for each diass session. , • - < 

The project objective of delivering the course vfa satellite was . 
achieved with minor exceptions. .There w^e- a few equipment malfunctions 
at individual classroom sites which precliided the viewing of several 
programs. Videotapes and ather materials were made available to students 
at these sites to make up the class activities missed. The major equipment 
problem was associated^ with the four-channel audio review equipment: the * 
equipment '^c^s delivered late and designed poorly. In fact the .equipment 
was available to students for less than half of the programs, but printed 
scripts were substituted for the earlier programs*. The transmission*! 
• /eception, and general equipment successes and failures are dejtailed n"n 
AESP Technical Report #5 (Bramble, Ausness, and Freeman, 1975). ' 

This report discusses the att^tudinal reactions of the course/"^- 
participants to the set of instructional 'activities that make up the^ CEE 
course. The perceptions of the site coordinators and consulting facjilty 
in* regard to the effectiveness of the instructional techniques are also 
discussed. As.a result of these discussions, recommendations for improve- 
ment of instructional tectiniques can be made. 
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-METHOD 



Subjects 
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Data on'thn Career Education in the. Elementary School (CEE) course 

* '* ^ . • 

were collected from three different groups: 1) course parti CH pants, 2) site 

coordinators, anrf 3) consulting faculty members. A brief description^of the 

characteristics of each of these groups is, presented below. 

- ^ o ■ ■ , /. 

Descriptioq of Course Par.ticipants ^ 

A total of 250 students initially enrolled in the CEE course,. 236 
of whom completed the course. The number of participants at each site v<bo 
enrolled and who completed this course is presentecf in Table^Ti 

The Confidential Background Questionnaire (CBQ) was completed by 
each course participant. A topy' of this instrument and its descrij^ion 
may be found in AESP Technical Report #4 (Bramble, et a^, 1974, pp. 87-88). 
Participant characteristics, as reflected^on the CBQ are discussed at length 
in AESP Technical Report f9 (Marion, Bramble, and Ausness, 1975). 
'Summarizing these data, it may be said that ^three , .fourths of the course 
participants were femalesi 185 of the students were' teachers, about half of 
whom taught in an elementary school; and .37 students had previous experience 
teaching career e^ducation, averaging 2.9 years instructing in this field. 
All but two students held a baccalaurea^ degree, with 229 course participants 
holding a master's degree or above. Less than 12% of the course participants 
had previously taken either a graduate or undergraduate course in career 
education. . • 
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Description of Site Coordinators , 

^ The site coordinator's duties consisted of 1) organizing the cllass- 
room activities of the students, 2) monitoring laboratory sessions, and 3) 
cdordinatipg the daily evaluatiorr activities. The site coordinators also 
acted as a liaison between the' students and the RCC. A full description* 
of the duties of the site coordinator can be f<)und in AESP Te^hi4<^'l 
Report #2 (Ausness and Bowling, 1974). Descriptive characteripics of the 
site coordinators are summarized in Table 2. ' 

Description of^Cysulting Faculty Members 

The duties of the consulting faculty members consisted of^l ) acting 
as a liaison between the RCC and cooperat+fig^universities, 2) consulting on 
progrs^m content* 3) acting as a consultant for students, and 4) observing 
and evaluating the instructional programs. Each triangle had the^§,erv/ces 
o^one consulting faculty member, making a total of five for the CE^ "course 

Iif%formation> concerning the consulting faculty was obtained from the 
Consulting Faculty Background Questionnaire (CFQ), referred to in AESP 
Technical Report #4 (Bramble, et al, 1974, pp. 94-95). Information from 
the CFQ indicates that three of ^the consulting faculty members held an* 
Ed.D., one a Ph.D., and the other an M.S. All five consulting faculty 
members hav« taught career education concepts in their classes. Three of 
the consulting facu»1ty members have helped schools to install career , 
education programs . Their names, the universities they represented, and 
the site's they observed are listed below: 



Dr. Ronald Clifton 



Frostburg State College > 
Cumberland, Keyser, McHenry 



99 




10 

^ TABLE 2 



.A 



DESCRIPTIVE CHARACTERISTICS OF SITE COORDINATORS 

' . (N = 14) / . ' ; 



Frequency Percentage 



2. 



Sex 

' I Male . 
• FejTial e " 

t 

Highest? Degree Completed 

EfaccaUureate 
Masters 



8 
6 



.3 
11 



57% 



' 21% 

79% 



3. Work Experience as: . 

' Elementary Teacher 
Junior High Teacher 
Undergraduate College Teacher 
Graduate College Teacher ^ 
Elementary School Principal 
Junior High Principal 
^ Senior High Principal 
Counselor ' 



7 


50% 


8 


, V 57% / 


7 , 


\ 50% / 


4 


■ ^ 29% / 


1 


\ ' 7%- 


1 


\ 7%/; 


1 


\ 7%/ 


3 


' ivi 



^ 4. Courses Taken in Career Education Area 

0 
1 
2 

3 • 
4 

5 or more . 



5. Taug^ a Career Education Course? 



ERIC 



10 

^ 1 
1 . 

. o ^- 
1 

1 , 



1 ' 

13 



7% 
93% 



TABLE 2 -- CONTINUED 



Frequency Percentaige 



5. Integrated Career Education Concepts 

• into a Class you taught? 

Yes - 

• Wo 

Have not taught 



4 



57% 
29% 
14% 



7. Attended Workshop or Special Training \^ 
Sessions in Career Education? > 

Yes ■ . 

No . « / *■ 



\ Q 



36% 
64% 



.8. Helped plan or establish a Career Education 
Program? . ^ \ 

. Yes / 
No 



6 

8. 



43% 
57% 
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Dr. Peter T. Glofk^ - St. Bonavehture University. f 

Fredonia, 0>ean, Edinboro 

Dr. Rich^d K. Garwood - University of Virginia 

\^ . Norton, Sticklyville, Boone 

Dr. Gerald K. LaBorde - University of Tennessee 

Lafonette,^a1 field, Johnson City 

Ms. Bernice .Richardson - Alabama A & M University 



Huntsville, Guntersville, Rainsvine^ 



A full description of the duties of the ConsuUir»g-sf acuity can be 
, • •-».■'. • « , ■ ' >. - . 

found ;n AESP Technical Report #2 (Ausness apd. Bowling, 1974).' ^ ^ ' 

Procedures and Instrumentation ' ^ 

* — 

« 

Each class day began q.t 8:30 am EOT and ended at^3:30-pm EDT, with 
an hour provided for lunch. It As important to'npte ^hat the participants 
attended class eigiit times and that they viewed and performed associated 
' audio review and laboratory activities for two programs on most class days. 
On a typical class day the first activity was watching a video program^and 
comp1e,ting the associated audio review. Immediately after this a second 
video program and its associated audio review were broadcast. Later, the 
laboratory activities associated with each jirogram were completed. Table 3 
shows when these activities were undertaken. Seminars were shown before the 
videotaped program on days when only one videotaped program was scheduled 
and^prto^r to the laboratory activities when' two videotaped programs were / 
scheduled. ^ 

Evaluation instruments measuring attitudes toward the CEE cotirse 
focused on the. four major instructional activities used in the couVse: 

. ■ . >i ■ . ■ ■ 
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" -TABLE 3 

PREPLANNED 'SCHEDULE OF LEARNING ACTIVITIES IN CEE COURSE 



Session Date Video Program Audio ReWfew 



Y 



Seminar 



Laboratory 
. Activit^f 



fx 


July 2 


1,2 






^ 1, 


•< 

2 


July '9 




■' , 3, 4a . - . 






2 


3 


July 16 


. 5 




1 • 




3 ^ ' 


,4 


July" 23 


- 6, 7 








4 


• 5 


July 30 


8, 9 


8,9, 






5( 


6 


Aug 6 


10 


1^^'^"'^ 10 


2 




1 ^ 


7 


^ Aug 13 


11 


11 


3 




I' ■ • 




Aug 20 


12 




4 . 




1 8 


the vtdep_Jecture, 


folir-channel 

■ ^- . . 


\ 

audio review, the live. 


interactive 


sem- 


nars, 

1 



and laboratory activities, including'tnformation systems. Table, 4 lists 
the instruments used in this report and gives a synopsis of the information 
contained in theni. For more compf^^information concerning the' evaluation 
instruments-, the* reader is referred to AESP Technical Report #4 (Brcimb\l|, 

et al, 1974). ' " " j 

<^he main 'instrument usecf to measure attituc(^s concerning t|ie video- 
taped programs was the Televised Lecture Questionnaire (TLQ). This J 
instrument was administered to the students at the end of each videotaped 
program. The tCq consisted of 27 five-point, Likert scale items concerning 
the quality of, the programs." 
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The main instrument used to' measure attitude^ toward- the four- 
channel audio review wa§ the User four-Channel Audio Questionnaire (UFCA). 

This instrument was administered to the students at the end of ev^ry four- 

/ . 

channel audio review session. Jhe UFCA consisted of 17 five-potnt, Likert 
. * . • > \ 

scale items rating the souncl, timing, mechanics, and content of the four-i ^ 
channel/^audio review. , V . ' - 

^ The major instrument used to measure attitudes concerrfing the live, 

interactive seminars was the Seminar Ques'tionnaire (SQ). -This instrument 

■* ' ■ ' 

was administered to. the-students at the .end of each seminar. The SQ 
consisted of 21 five-point, Likert scale items concerning the quality of 
the live seminar ^presentation. " * 

The Laboratory Activities Questfonnaire (LAQ) was administered 
to the students at the completion of. each session's lab act^ity. The LAQ 
consisted of 22 five-point, Liker^t scale items. . v 

Student attitudes concerning the Information Systems were gathered 
on the Information System User Satisfaction Questionnaire (ISUSQ). The 
ISUSQ consisted of 25 five-point, Likert scale items, half of which were 
concerned with the Computer-Based Resource Guides- and the other half with 
ERIC and AIM/ARM data base searches. 

For all of the instruments used, except the Instruction Feedback 
Questionnaire (IFQ)j the instructions for the. use- of the five-point, Likert 
?cale were: 

Rate the Statement as 5 if you strongly agree: ^ 

4 if you moderately agree 

*^ ■ 

3 if you feel neutral 
2 if you moderately disagree/ 
'1 if you strongly disagree 
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Each of T;he five' instruments (Tlh, UFCA, SQ, LAQ, and -ISUSQ) was 
factor analyzed, and several different factor solutions weioe^ obtained, for 
each instrument. Fon the factor apalysis R^s were inserted o>i the diagonals 
of the cor*relation matrices. Factors with eigenvalues greater than 1,00 
were retained and subdected to, VARIMAX rotation, From^the fiiwl rotated 
factor loadings, items were selected to measure the scales defi nerd by' each 
of the factors. Items generally were retained for measurement of the factor 
on which thW loaded most 'heavily \± .30"* was the cut off point for inclusion 
on a factor).. Where ambiguities^ccurred based on varying factor solutions,.:^ 
items were assigned to factors based on the semantic content of the item. 
For each instrument the names of the factors and the itemsv included In the 
factor ^are pre^^ed in Table 5. • For each program, factor mea'rjs were 
computed by averaging across the item means that composed the factor. For 
each instrument the results are discussed in terms of factor means, and item 
means for each instrument are presented in Ap[3endix B for those who want a 
more detailed picture of participant reactions. " , 

Information concerning each course activity was gathered from the 
participants on the Instruction Feedba<^k Questionnaire (IFQ). This instrument 
. was administered after the completion of. each third of the course (on 

♦ ■ 

July 16, August 6 ,and August 20, 1974) in order to measure participant • 
attitudes toward the major learning activities". The IFQ consisted of 9 
five-point, Likert scale items with space provided after each question for 
written comments. For the ratings, the participants were asked to make 
their standard of reference an average, graduate education course and to 
follow the fpl Towing guidelines: ^ 
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Rate the/^atement as 5 outstanding, if you received a lot more 

from the activity than from a comparable 
<^ \ ^ activity in a graduate education course; 

4 good, if you received a little more from 
the activity than you usually obtain from 
similar activities in a graduate education 

- . coursej \ 

3 average, if you received about the same 
amount from the activity; 

2 poor, if you received somewhat less; 

1 unacceptable, if you received a lot less 
infarmation from the activity. than you 
. ' usually obtain from similar activities 

in a teacher preparation course. 



An overall evaluation of each activity was obtained at the conclusion, 
of the course from. the site' coordinators and consj^^ting faculty on the 
Surranative Report Form (SR). This instrument provided them the opportunity, 
primarily through the writing of comments, to give a summary of what they^ 
considered to be the distinctive features of the CEE course. It also - 
allowed^them the opportunity to make recommendations for course revision. 

. For each of the four main instructioi^l activities a selection of , 
the written comment^ is included. In each case the comments .were selected 
according to the following criteria: 1) Include negative and positive 
comments in proportion to the total distribution of comments received, and 
2) inslire that all major complaints are inclucjed. 
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RESULTS 

m 

, Th*1s section contains a summaHzation of tne data obtained from the 
rating Instruments. Data are presented for each qf the major activities 
rated; pretaped video lecture, four-channel audio review, laboratory 
activities, and live seminars. Participant and site coordinator reactions 
to the evaluation procedures and rating scaTes are also discussed. In the 
Method section It was explained that for the TLQ, UFCA, SQ, LAQ, and ISUSQ ' 
a rating of 3 was to be given when the participant felt neutral towards a 
Statement. From a careful comparison of written comments to ratings on the 
instruments' It was felt that with a rating of 3 th6 participants actually' . 
expressed an attitude of being Imp^-essed neither positively nor negatively 
with the activity being rated. Thus, mean ratings of 2.5 to 3.5 are Inter- 
preted as "non Impressed." The mean Item range of 3.5 to 4.5 Is considered 
to be a moderately to strongly positive attitude and 1.5 to 2.5 Is 
considered as strongly to moderately negative attitude towards the aspects 
^TTihe learning activity being con'sldered. \^ 

Videotaped Programs 

From the factor analysis of the Televised Lecture Questionnaire^ 
(TLQ), two factors were obtained; 1 ) -jelevision viewing conditions (high 
ratings indicate favorable conditions) and ^overall quality of videotape 
presentation (high 'ratings indicate high quaTl-ty). The numbers of the items 
that make up each factor, as well as the' factor means for each program are 
presented in Table 6. If the reader wishes to refer to the participants* 
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ratings for individual items, item means and overall-means are presented 
in Appendix B, Table A. ' I ' ' ^ - 

On the first factor it maybe concluded that overall the television 
viewing conditions were favorable Nsince all program means f|^m Table 6 viere 
above or near to a four rating. Programs five and eight have the only 
means that are below four. 

.Because the second factor was the student reaction to the overall 
quality of the programs^ it was decided to rank-order the programs according 
to their factor means. The rankings are pres,ented\in Table 7. 

*TABLE 7 

RANKING OF PROGRAMS BY FACTOR MEANS ON TELE|1SED LECTURE QUESTIONNAIRE: 

'CEE COURSE ^. - 



Rank 


■ Mean 


Program Title . 


Program Number 




4.25* 


Complete C.E. program 


2 


2 


4.19* 


^Concept of C.E. 


1 


3 


4.16* 


Curriculum integration 


4 


4 


4.16* 


•Collecting and using instructional 
materials j 


6 


5.5» 


4.09 


Total curriculum i^^tegration ^ 


5 


5.5 


4.09 


Community resources 






4.o|j 


Special interests and C.E. "''^^ 


11 ^ 


8 


4.03 


Rewards /of a C.E. program 


12 


9 


4^01 


Job clustering 


" . ' .1.: 


10 


3 '.90* 


Dealing with edutational change 


10 . 


11 


3.82* 


Attitudes about .change . . 

. , ♦ ■ 


9 


12 


3.79* 


Implementation strategies 


8 



♦Significantly different from grand mean^^(GM = 4.05) at .05 level 
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In general, it may be seen that the programs from the first half of 
the course are rated high and those from the second^lower. Although 
this could reflect content or production differences among programs, a more^ 
likely explanation expressed by Pe'ler Gillette is that the- production . 
schedule was very tight and less time was available for the productit)n of 
the programs fo^ the latter half of /the course. Some of the later programs 

(nine through twelve) had to be pieced together with film clips used in 

• . • 

'earlier^programs and involved extensive us^ of the narrator. Bob Cooke. 
In fact, two external reviewers of the videotaped programs recommended that 
programs*8, 10, 11 and 12 be^vised due to their redundant nature. 

Item two on the Instruction Feedback Questionnaire (IFQ^) also concerned 
the videotaped programs and asked the participants to (jbmpare the video ; 
programs with on campus class lectures with which they were familiar (the 
means for all IFQ items are presented in Appendix B, Table B). The IFQ was. 
administered three times and «the means for item two were: 3.65, 3.28, and 
5,50,\These ratings are for programs one through five, six through ten, and 
eleven and twelve respectively^ "^Each of these means is significantly greater 
than a rating of 3.0 (3.0 indicates equivalent to a typical campus lecture). 
The -overall mean rating for the videotaped^programs was 3.49. This value iS' 
significantly greater than 3.0, but in practical terms not much greater. 
One can conclude from the ratings the students thought that these * 
videotaped programs were only s^S?ht1y better than typical campus lectures. ^" 
: Many comments written by the participants on the IFQ with regar^j.-'to the 
televised programs expressed s^ttisfaction with the organization and design , 
of the*programs. The participants liked the classroom sequences and the 
interviews with Career Education "experts." 
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"I especially ertjoy tm filmed classroom examples^. Very 
interesting. Visual Aspect of lecture is greati" 

"Having "experts" giving opinions is good." 

"Lecturer is exceptionally articulate a'nd materials are 
well organized." ^ 

"Very well organized^and helpful . " 

"I thought the programs were well planned, clearly organized 
providing much useful information," 

"Actual instances and v.iewing^terials and cgncepts in use 
is more valuable than lecture." 

* ^ 
"Having filmed talks by authorities gave more , mean i ng. " . 

"The visuals used during the telecasts and the comments by 
several other "experts^'^tidded a great deal." 

"Very good consul tants who faced issues and were' helpful in 
justifying career education." 



The participants commented that they felt that\th§ programs were sometimes 

too redundant and designed to convince people of^the value of Career 

Education rather than illustrate teaching techniques and implementation 

strategies. They also said th&t the programs were impersonal' In that there 

was little opportunity to ask questions and clarify misunderstandings. 

^"Thus far, programs seem to be wel 1 -structured, but moderators 
..^omments/classroom activities observed appear to be too repetitious 
' ^md at times over-simplified." 

"Actually, the programs are geared toward attitude improvement-- . 
I have the attitude, I want the methods 1" ^ 

"Too impersonal . ^ A site coor.dinator is not the same as a 
4)rofessor . " . * ^ 

"TV does noVallpw for questions and answers, and ^minars do 
not provide enough opportunity." . ' . 

' "The' instructor ^id not seem to enjoy what he was doing." j 

"No way to 'clear up a ^student question or express disagreement." 
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"One problem has been that many speaker^'give their own feelings 
and define terms differently. This leaves the student in a quandry." 

S 

Cooinents by the site coordinators, from the Summative Report Form 

(SR), are overall very favorable and express many af the same concerns as the 

participants' comment^id. The site coordinators felt that the [program 

content was excellent, but that there was -tod much redundancy. Alfo, they . 

suggested, greater use of specific classroom examples and less emphasis oji 

"selling" the conept of Career Education. . . . 

"On the whole, the course was excellent in content— but some of 
the parts might have been put in different order to the grelater 
benefit of the students." . 

^•Students felt the tapes were tgo redundant and there were too 
many interview segments. The material could have been condensed." 

"Ths course was presented with a qu^itv effort that ma^ i^ 
generally appealing and easy t^o foil oW However, there was a 
touch of redundance in using some materials repeatedly. The 
^ students reacted well to the ccJurse in general but did respond 
negatively to redundant efforts." * \^ 

^ "Student reactions indicated a feeling that the last 5 tapes 
should have included more' examples qf^etassroom handling of 
ideas expressed by t!ie various leaded." .« 

\ " 

"More actual classroom experiences needed to have been shown. 
Not specific enough." ' ' 

"The lectures seemed to be very repetitious in content. It would 
have been most helpful to have had unfamil iar, .extensively-used 
terms defined at the beginning of the course or|in the first l|pture 
rather than after student inquiry in 3rd and' 4|h weeks. Prestation 
of lectures was excellent other than degree or repetition of 'Some ^ 
video shots." . 

I ■ 

"Too much of a sales approach. Concentrate more on what an 
individual can do in a sel f«f contained classroom." 

The consulting faculty membersj^e very positive in thfeir overall 
ratings- of. th^ televised programs. They were asked to rate the^og/ams 
oi^a 5-point Likert. scale (5 -Excellent, 4 - excellent at tilffesr 
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3 - acceptable, 2 - weak, -and T - unacceptable). Their average rating was 
4.05. Their comments generally emphasized the redundancy mentioned earlier 
by the particjpants and site coordinators. 

"Too much repetitiqp (scenes, people)*" 

"Amount of content during several telecasts was too much. Too 
,much material to be compfehended at one time." ^ 

"Last program somewhat repetitious of earlier material, although 
' this may be a function of being a summary program." 

"Lectures offered relevant information, however, format was 
sometimes stiff. Perhaps more questions with answers may prove 
helpful." 

Four-Channel Audio Review 

The factor analysis of the User Four-Channel Audio Questionnaire 
(ypCA) identified five factors. Thyfese factors were: 1) characteris4:ics 
of sound (high rating indicates a<fequate sound), 2) time allowed for ^ 
different aspects of audio review, e.g. putting on earphones, answering 
questions (high rating indicates sufficient time), 3) mechanics of- 
presentation, e.g., speaker spoke clearly (high rating indicates mechanics 
adequate), 4) enjoyed using- audio review equipment (high rating is adequate), 
and 5) quality of audio review content (high rating is adequate). 
The factor means are'presentfed in Jable 8 and for a more complete picture 
the reader may refex to the item means presented in Appendix B, Table C. 

Prior to program 8 the audio review equipment was either not 
installed or not operating well enougSor data to be collected. At some 
:,^_sjies the participants hear^ more than one channel at the same time;, and, 
at times, .the participants di^ not hear the channel they sefected [see AESP 
Technical fteport #5 (Bramble, Ausness, and Freeman, 1975) for a detailed 
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discussion of the .technical problems]. Only for the fifth factor (contenyf^ 
could data be collected for all programs. This was possible because the 
participants ^ere supplied with written scripts for use wnen the audio 
review system was not operational. ' \ 

When the audio equipment was operational , Generally from programs 
eight on» the participant ratings were^ositive for\ factors one through four. 
Also, positive ratings were obtained for factor f1ve\(content), for all 
tweTve programs. 

As a general conclusion the content of the audib review segments 
was rated overall aTl)e1ng adequate. Also, when the equipment was 
functioning the participants enjoyed using ^t and found th^ quality, of sound 
^^^[id other aspects to be acceptable. * 
• Item three on the IFQ asked the participants to rate\the audio 

' review through comparison with "class quizzes folloWd by class discussions 
of the answers" (Appendix B, Table B). The mean ratings for tfjis item 
were 3\52, 3.24, 3.46 for the three IFQ administrations respectively. The 
firsts mean (3.52) is -based op the participants reactions to reading the 
scripts, the last two ijifeans (3.24 and 3.46) are mainly based on the 
participants reactions to actually using the foiir-channel equipment. How- 
ever, several sites were still unable to*use.the audio review equipment 
for some of the later programs (even programs 8-12), and their content 
ratings would be based on the written scripts in those instances. It may 
be concluded from these ratings (3.24 and 3.46) that the participants slightly 

favored the audio review activity when it was compared to the similar on 

" j.-j / * 

campus activities of class quizzes and subsequent discussions. 

. \'-' 
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. 1 Participant comments on the IFQ indicated that the immediate feed- 
back obtained with the audio review was its^most positive feature. The 
participants also felt it was an unusual technique and a useful one. 

"Provides more immediate^response - rein|({rcemerit or c/rrection 
of error." ^^"^ - 

" Instant , personal feedback is a good learning situation." 

"This method is great - helps you learn why your answer is shaky." ^ 

"I am seldom correct, but I like the immediate evaluation and 
explanation of the best answer." 

. V 

"Very complete and practical answers in confirming concepts 
being taught." 

"Interesting as a change from the usual." 

"This is pne of the most useful activities of the course. It 
was personal^ comprehensive and meaningful." 

The participants felt, in some cases, that the questions were subjective 

and not closely related to the (television program. Some participants noted 

that they ha^ difficulliy following the oral presentation. 

"Good concept'but several questions are quite subjective." 

"It is helpful to have feedback on correct answers as well as 
incorrect. The questions are often too closely related. 
Often incorrect responses appear correct." 



f "Did not feel that iti some cases these pertained to TV program^ 

specifically." * 

"Audio does not quiz on what is shown on video." 

"We have poorly developed listening skills. I find it difficult 
to follow the problem." 

"It .is easier to just read and answer questions." 



t : • 



30 



The comments made by the site coordinators indicated that the 

participant reaction to the audio review was generally favorable. However, 

the difficultie^^ith the equipment, the ambiguity in some of the questions 

and the slowness of the timing tended to reduce participant enthusiasm for 

the audio review. * ^ 

"Students responded very favorably to the four-channel audio 
portion of the course. The technological involvement stimulated 
student interest." . 

"Activity was excellent at times." 

"Served as good reinforcement tool." 

"What you did was excellent but shorter questions and answers 
would be" more effective. &Mminate one minute pause. 15 , seconds 
for long questions and 10 seconds for Shorter questions would 
be fine." 

"Very poor reaction - most simply ignored the process; turned 
off by technical problems for 1st half of course and having 
to waij: for responses for full minute." 

I think the software (instructional material) in this way 
was probably the weaker- of the elements in a day's prograrnming* 
Timing was tpo slow. Item questionis were too long. Answers 
were at times obvious. I hope that these trial runs will provide 
suggestions which will assist fut^ure revision." 

"Students preferred the scripts over the headsets. They felt 
too many questions w;ere ambiguous and irrelevant." 

"Questions, situations etc. should be kept to a minimum (brief) 
and also the responses. This would allow for more points to 
be covered relating to the lecture and increase the effectiveness 
of the review. The technology i'^ new and tends Jo overwhelm ' 
the teachers for a few weeks." 

"The four-channel audio sjDeaker spoke too fast." ^ 

"Too often there was a feeling that the questions could have 
been answered without ever seeing the TV lesson.' Hence a need 
' to relate the questions more directly to the telecast." 



. if 



Overall, the consulting faculty rated^ the audio review as being 

acceptable. Tfieir average ra4;ing was 3.44. Their written comments .suggested 

that sometimes the instructional activities did not deal sufficiently with 

thI'Vpics the audio review dealt with and that some questions were ambiguous 

as to the correct response. V ^ 

"At times learning activities did not provide students 
sufficient knowledge with whic^ to recognize discrete 
. differences among alternatives." ^ 

' - "Discrimination of response choices:*wafs often unclear. 
' Students had no opportunity to explain their selection." 

, "Generally good." ' , 

The response of the participants to the questions asked during th^ 
audio review were to be recorded two ways. The responses .were recorded 
on Op-scan sheets by the participants, and the alternatives selected via the 
•response buttons were to be automatically recorded on magnetic tape at seven 
of the classroom sites. The equipment that was to automatically record and 
decode the responses was engineered incorrectly and the recorded data could 
riot be decoded. The participant responses from' the Op-scan sheets- are 
summarized in Table/^. - ^ - ■ . . - ; 

^ The proportion of participants that selected the correct alternative 

ranged from .43 to 97. For two-thirds of the items in Table. 9, 70% or more 
of the participants selected the correct response. It may be concluded • 
that generally the questions asked were easy to answer. The questions were 
designed to r^"n force the concepts of the- video programs thus i^ is appropriate 
that a significant number of participants answ^d the -questions correctly. 
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TABLE 9 . ■ ' 

' . ■ AUDIO REVIEW QUESTIONS*: CEE COURSE 



Program 


;^uest1ons 


♦^Proportion Selecting 
Alternative 


Number 
of Students 


• 


1 


2 


3 


4 


1 


1 
2 

3' 
4 ' 


.23 
.01 
.02 
.75* 


.01 
.00 
• .02 
.16 


.76* " 
.13 
.94* 
.08 V 


.00 
.86* 
.02 
.01 


. 232 
' 232 

( 232 
\ 232 

\ ^"'^^ 


2 

* 

T 


1 

. 2 

3 1 
4 


' .80* 
.98* 
.01 
.00 


.02 
.01 

^do 

\ .01 


.13 
.00 
.00 „ 
.49/ 


.05 
.01 
.99* 
.50. 


; ■ 2^0 

220 
220 
220 


3 


• 1 
2 

• 3 

4 d 


.00 

- .05. 
.05 
.01 


.01 
.08 
.05 
.02 


.97* 
.01 ■ 
.81* 
.82* 


.02^ 
.93* 
.09 
.15 

• 


227 
227 
227 
227 


4 


1 

2 
3 

■ 4 


.08 
.01 
.04 
.27 


.87* 
.07 
.26 
.57* 


.01 
• .01 ' 
.07 ' 
.03 


.04 • 
.91*, 
.63* 
.13 


143 
143 
143 
143 


5 > 


rV ■ 

■ 3 V 
4 


.01 
.00 
.02 
.03 • 


.12 ■ 
.09 
.02 
.88* 


.19 
.88* 
.62* 
.00 


.68* 

.03 

.34 

.10 , 


227 
227 ^ 
227 . = 
227 


6 . 


1 
2 
3 

r4 " ' ' 


. .82* - 
.91* 
.12 - 
.26 


.03 . 
.12 
.07 
.02 


.13 
.13 . 
.02 
.71* 


.02 
.04 
.79* 
.02 


213 
213 
213 
213 



^Correct answer 



TABLE 9 - CONTINUED ^ 



Program 


Question 


^ Proportion Selecting 
Alternative 


Number 
of Students 


1' • 




7 


8 




7 


t I 


.10 


.70* 


. .14 


.06 


1 /I c 

14b 




2 


.08 


.03 


.31 ' 


.58* 


145 




J 


.21 


.27 


.09 


^ .93* 


1 yic 
.1 40 




4 


.07 


.8V* 
/ 


.07 

• 


.05 


1 yi c 
I4S) 


O 


1 


.01 


.42 


.52* 


.05 


999 




2 ' 


. .02 ' 


.01 V 


.00 


.97* 


222 




6 


.D5 ■ 


.92* 


.03 


.00 


999 




A 


.79* 


.05 


.16 


.00 .. 


999 


n 

9 - 


1 


„. .07 


.-38 


.48* 


.06 


001 
ccl 




2 


.02 


.61* 


.08 


.29 


227 




3 


.71* 


.24 


.04- 


.01 


997 

ccl 




4 


.01- 


.22 


.77* 


.00 


cco 


10 


1 


.00 


'.38 


.61* 


.01 


91 1 
^11 




2 


.29 


.01 


.68* 


.02 


211 




3 


.0.3 


• .41 


.53* 


.03- 


til 




4 


.21 


.72* 


.01 


.06 


f 1 1 


11 > 


1 
1 


.00 


.00 


.96* 


.04 


' 226 




2 


.04 


,id5 


.72* 


.19 


226 


4. 


3 


.01 


"'.00 


.18 


.81* 


226 




4 


.01 


.07 


.24 


.67* 


226 


,12 


,\ 


.00 


.01 


.02 


.47* 


' 226 




2 


.87* 


.12 


.01 


.00 


226 




3 


.00 


.00 


.63* 


.37 " 


226 




4 


.02 


.81* 


.02 


.15 


226 



*Correct answer 
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Laboratory and Other Activities ^ ^ 

The factor analysis of the Laboratory Activities Questionnaire (LAQ.) 
indicatfed five groupings of items that were descriptive of the participants' 
reactions to the laboratory activities. The five factors were: 1) adequacy 
of time and facilities available and appropriateness of amount of material 
covered during the laboratory (high rating indicates adequate and . 
appropriate); 2) usefulness of laboratory as- a hands-on illustration^of 
lecture concepts (high rating indicates useful); 3) usefulness and. 
attractiveness of the laboratory Gpntent' to the participants (high rating 
indicates useful and attractive); 4) helpfulness of the site coordinator' 

j(high rating indic.ates helpful); 5) clarity Of the purpose and directions" 
for doing the laboratory. ' The factor means are presented in Table 10 and the 

. item means are presented in Appendix B, TableJIj^ 

To aid in interpreting the LAQ data the pl"ograms were ranked from 
high to low on each factpr. Ttie ranking are pirejsented In Table n .^To 
see if there was any consistency in the program rankings across factors, 
Kendall's coefficient of concordance was computed (Hayes i Winkler, 1971, 
pp. 849-85?). The value obtained for W was .273. This value iffdicates 
a I'ow degree of similarity in tKp order of ranking across factors. For 
each factor, program means that were significantly different at the .05 
level from the graYid mean for the factor are marked' with an asterisk (*) 

in Table 11.7 • 

The laboratory activities that were rated hig'hest on one or more 
factors were 1&2, 5, 11, and 12. Of these onjy 1&^, 11, and 12 appeajc 
high on more than one falctor. . The" laboratory activities that were rated 
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lowest on one or more factors were 3&4, 5, 6&7, 8&9, and 10. Of these only 
3&4 appear low on rapre than one factor. Generally, then it may be concluded 
that laboratory activities 1&2, 11 and 12 were the bfest received activities* 
and thaf laboratory 3&4 was the poorest. If we look at the content of 
-these activities (see^ Appendix A, Item B) a clear cfWtinctlon^can be made 
^etween the high and low rated laboratories. Laboratory UTS' deal t with 
wi^h the makirfg of a "Life Rope." This was a small group activity with a 
lot of personal interaction and discussion. Laboratories 11 and 12 were 
also small group activities that dealt with stereotyping. In laboratory 
11, the participants did role playing of stereotypes in the world of work. 
In laboratory 12, they discussed stereotypes they had observed during 
interviews they had made.during the previous week. Thu-s, the best f^ated 
laboratories were the ones that encouraged interaction between participants, 
provided fbr discussion and sharing of experiences, and included small 
group activities. 

The poorest rated laboratory dealt with the development of job 
clusters and the development of a collection of employer and job descriptions • 
of the Appalachian region called the "Yellow Pages of the Working World." 
This laboratory consisted of reading and research, about jol> clustering 

schemes and an explanation of how to gather employer and job availability 

- ■ ■■ ■ ! ■ 

data. , " 

Factor 5 on the LAQ is a measure of the student's perceptions of 
. the helpfulness of the site coordinator. As indicated in Tablj/lU site , 
coordinators were generally thought to be quite helpful during the 
laboratory activities.- The range of mean responses was from a low of 3.91 
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for the laboratory for programs 3 and 4 to a high of 4.41 for the laboratory 
for programs 1 and 2, with a mean of 4.26. Students tended to be 
consistent in their -fating of the site coordinator's helpfulness. 

Item four on the IFQ (see Appendix B, Table B) asked the partici-. 
pants to compare the laboratory activities to laboratory experiences they 
had in other college courses. ' The means for the three administrations of 
this item are 3.71, 3.54, and 3.64. These ratings indicate that the . 
participants felt that the. CEE laboratorj^ activities could be favorably 
compared to those from other courses^ * 

Participant comments in the IFQ that related to the laboratory 

sessions were generally very positive especially towards the practical 

-trtlTttj^ of many of the ac^tivi ties. The interaction with other teachers 

was -also seen as a positive aspect. 

"Very^helpful . I can very definitely see how I^will be able 
to apply these activities in my own classroom."*" 

"All practical experiences for later use." 

"Most of the activities were very interesting. I could see 
direct application to my teaching*situation." 

"It'has been very interesting' and helpful working w!tfi^)the' 
other teachers. There has been a lot of brainstorming and ^ 
^ exchanging of ideas."'' \ ^ ^ 

"Interesting but sometimes we found ourselves disorganized, 
. not knowing what to do." 

"Need more directions and explanations.". 

"All of the activities are great. Need more time to do' them." 

"There were too many activities in additton to the learning 
packages." 

"Discussion with groups and working 'hands-on' more valuable 
th/n readings. Readings are important but not if there can 
, beSio discussion, etc." , 
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"Took much time in written work. I had little time for 
recreation." 

"Not enough correlation between laboratory activities and TV 
program." ' 

Site coordinators comments on the SR were very positive; however, 

they felt that the directions could have been clearer for some sessions, 

and that more time was needed for discussion. 

"Best part of course.- Concentrate on activities teachers can / 
use with child. Life-line activity was one of the best. Who- 
ever designed these activities was creative and imaginative." ' 

"Excellent." 

- i ■ . ■ . • . ; ■ 

"Students ind-'cated that these (especially when discussion 
was a part) were most valuable component of the cours^." 

"The lab activities were excellent. The mature student can 
benefit greatly from such activities." 

^'Very well received. Suggest site monitor have an advanced 
copy of activities requiring special equipment and/or instructions 
' such as Week 7 - stereotyping waste paper retrieval activity. 
Nothing to site monitor specified ful 1 cans and did not know 
what* students would be doing since these instructions were in 
the student packages." • 

"The course materials were excellent; need more materials in 
^the area of information searches, guides, etc. Directions 
for some units should be clarified." 

"Mo^e time needed for discussion, talking with other, sharing 
ideas - more time for cVass interaction." 

The consulting faculty members rated the laboratory activities on 
the SR as excellent (average rating 4.80). Their comments reinforce this 
rating. 

"Excellent— provided suffipient opportunity for transfer of 
learn|ng." * 

"Excellent." ^ ^ 

"Well planned. Held general interest of students." 
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In cdnclusion, the laboratory activities were considered to be 
generally very good; however, the best sessions were those that emphasized 
in-class activiti.es, small group participation and interaction and discuss'ion 
among the participants. In some cases, the directions needed to be clearer. 

Two major components of the laboratory activities were 1) the 
availability of computer-assisted information retrieval -systems and 2) a 
reference library at each site that contained all necessary materials to 
carry out the laboratory activities. 

There were two retrieval systems available to the participants; 
Computer Baseci Resource Guide, and Educational Research Information 
.Centers (ERIC) and AIM/ARM tape files. Descriptions of the 'information 
systems employed and how they w^re used by the participants are contained 
in AESP Technical Report #2 (Ausness and Bowling, 1974,.pp^ 20-^2). To 
.use the information systems, participants requested iijfformation searches 
by mailing a request form to the University of Kentucky. The search was 
processed and the information returned by mail. 

The reference library contained materials, books and test 
instruments necessary for the participants to complete the laboratory 
activities. Included in the reference library were sample information 
retrieval searches run for a variety of career education topics. Also 
included were sample curriculum plans illustrating career education 
appfi cations in the .classroom. It also contained supplementary materials 
that expanded upon the basic program. 




The Information Systems User Satisfaction Questionnaire (ISUSQ) 
was factor anc^lyzed and four factors were obtained.. The factors are: 

-nVvalue of information obtained from information systems (high ratings 
indicate high value); 2) information systems were useful as information^ — 
sources (high ratings indicate useful); 3)- adequacy of explanation 
and ease of use of information systems (high ratings indicate adequate);. 

■ and 4). length of time to get information back (high rating is acceptable ^ 
length of time). The factor means are presented in Table 12 and the item 
means are presented in Appendix B, Table E. The participants' ratings 
on factors two and three (3.17 and 3.12 respectively) indicate that they 
felt that the information systems were not highly useful as sources of 
information, that the procedures for use were not explained adequately, 

and that the hnformatiori^ystems were not easy to use., Factor one has 
a mean of 3.59, and it appears that the participants were positive towards 
the information they got from the information systems even though they 
generally unimpressed with them as information sources. In other words 
the participants liked the information they received but did not like the 
way in which they had to go about getting the information. Finally, on 
factor four the mean is 2.80, and apparently the participants were un- 
impressed V/ith the_?peed of receiving information back from the information 
systems. 
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TABLE 12 



FACTOR MEANS FOR INFORMATION SYSTEMS USER SATISFACTION QUESTIONNAIRE 

CEE COURSE 
(N=198) 



Factor 



Items on Factor 



Factor Mean 



1) , Value of information obtained 

from information systems 

2) Information systems were use- 
ful as information sources 

3) Adequacy of explanation 

and ease of use of information 
systems 

4) Length of time to get 
information back 



7-10, 13-18 



20-25 



1-4, 11. 12 



5, 6 



3.59 



3.17 



3.12 



2.80 
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Item six on the IFQ asked the- participants to compare the 
information systems to materials supplied in other courses. The means for 
the three\administrations are all positive (3.76, 3. 64, '3. 59) and indicate 
that the pe^rticipants were favorably disposed towards the information 
systems as compared to^metterials supplied in other courses. Participant 
comments on the IFQ indicate that they felt the information systems were 
not explained clearly and that they had insufficient opportunity to use 
them. ' ^ 



"Alth(|jgh I'm still somewhat uncertain as to how'to go a 
employing these (retrieval systems) I feel we'will need 
practi.cal application of these under supervision before we 
feel comfortable using it." 

"Want more time to investigate for search." 
"The system is^oo unnecessarily complicated." 
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"I would like to have had time to become better acquainted 
with this system. Seems to have a potential use for 
educators." - \ 

"I didn't really get much of a chance to use these materials* 

We made out one simulated request but that was all." 

i 

"Great but I didn't take enough advantaT^e of the^ offering. " 

"Couldn't use them during course." 
4 '*I did not use this method." 

'Site coordinators comments from the SR reinforce the participants 
comments. ^ 

"Activities dealing with information systems were the weakest, 
most complaints from students." 

"The retrieval section needs to be reworked and expanded." 

"AIM/ARM should be more.fuTly explained. Copies of the basic . 
information retrieval methods and system should be made 
available to each teacher." , " / 

In co,nclusion, the information systems needed to have, been 
explained more fully and more time should have beei^allotted to their use. 

Item five on the IFQ asked the participants to compare the on-site 

reference materials with materials provided^n other courses. The means 

for this item are positive (4.11^ 3.83, 3.93) and indicate that the 

participants 'were pleased with the on-site materials provided. Participant 

comments on the IFQ were generally very posit^ive towards- the on-site 

reference materials. Several participants felt the materials were in- 

sufficient for the upper elementary grades. 

"Materials provi^fed at site are excellent resource guides 
compared to most courses\" 

"Excellent resoa)/ces--easy to find and locate/' 

"Materials are ekciting and stimulating." 
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"Lots of materials— can be borrowed freely. Excellent." 

"Materials up to date which is sometimes no^t the case with 
reserve materials. Need time 'system to have materials reach 
, all class members." 

■ • ' . . • ' 

. "More reference material is needed for upper elementary." 

"There are not as many materials dealing with the ^upper ■ 
elementary grades as there are with the first three grades." 

' "Very good, i)ut only one microfiche reader." 

Two final aspects of the course were rated by the participants 
on the IFQ. There were'l) pre-program preparation compared to work 
assigned in other courses and 2) homework assignments compared to other 
classes. The pre-program preparation and homework assignments for each 
class meeting are outlined in Appendix A, Item B. 

The-^e-program preparations were usually readings to be 
completed prior to class. Participants' reactions to this were measured' 
by item one on the IFQ. The means (3.48, 3.25, 3.51) indicate a positiy^ 
reaction. to the pre-program preparation. Item 8 on the IFQ dealt with 
homework. The means for this item (3.66, 3.41, 3.62) reflect a positive 
reaction. 

The major homework assignment was'the development of a learning 

package. In this package the participant was to illystrate how he would 

introduce career education concepts into his teaching. Some participants 

felt thert they did not have sufficient time to complete the .learning 

package and do the pre-program preparation and other homework assignments. 

However, they did feel that the assignments were' useful and valuable. 

"I must spend so much time on my learning package that I 
find it difficult to do all the reading I want to do." 

"Today's homework assignment does nqt help me do my units 
and learning activities." 



"There was not enough time in the summer session to complete 
all activities." 

"I would have liked less work assignments, so as to develop 
a more useable career package. The activities and assignments 
were very well thought out and relevant.." 

"The learning package should be very beneficial to my school." 1 



Televised Live, Interactive Seminars , . ^ 

The S^nar Questionnaire (SQ) was factor analyz^^d and five 
factors were obtained. The factor means are presented in Table 13 and the 
item means are presented in Appendix B, Table F. 



TABLE 13 

FACTOR MEANS ON SEMINA8 QUESTIONNAIRE 
- CEE COURSE 



Factor 


Items on Factor 




Seminar 




1 


2 


3 


4 


11) Quality of presentation 
style of seminar 


2, 7-12, 19, 20 


3.54 


3.68 


3,73 


4.05 


2) Value of Information 

communicated during seminar 


13-16, 18 


2.65 


2.89 


2.99 


3.18 


3) Adequate opportunity to 
ask questions 


3, 5, 6, 15 


3. 75 


3.9C^ 


4.00 


4.07 


4) Important questions- were 
asked by participanxs 


4 


2.50 


2.49 


2.74 


2.89 


5) Proper time in course 
sequence for seminar 


17 


3.52 


3:81 


3.84 


4.06 



Factor one deals with the quality of the seminar presentation. 
Generally the participants felt that the quality was moderately high and 
that the quality improved as the course progressed; ThisJ/ seen in the 
gradual increase in the factor means across seminars: 3.54, 3.68, 3;73; 
and 4.05. . 

^ Factor twb deals with the value of the' information communicated 
during the seminars. As indicated by the ratings of 2.65, 2.89, 2.99, 
and 3.18 participants were unimpressed with the value of this information. 

■ . , Factors three and four are related in that factor three deals with 
the adequacy of opportunity to ask questions of the seminar guests and 
factor four deals with whether or not important questions were asked by 
the participants. The participa4nts felt that they had adequate opportunity 
to ask questions (as' reflected in means of 3.75, 3.90, 4.00, and 4.07), ./ 
but that important questions were not asked, (as reflected in means of 
2.50, ?-49, 2.74, and 2.89). Some data are available to illustrate the. 
frequencies of questions transmitted from the sites for seminars. On the ■ 
average, 85 questions were^ received and 20 questions were answered over 
the air during the seminar (the remaining questions were answered via 
teletype after the seminar broadcast). ». 

Factor five dealt with whethl^r or not each seminar was broadcast 
at an appropriate time in the course sequence- The participants ratings 
(3.52, 3.81 , 3.84^ and 4.06) indicate \that the seminars were broaucast 
at appfoprtate places in the course se(i|uence. 

Item seven on the IFQ asked the^^partici pants to compare the 
televised seminars with the seminars an\l class discussions from other 
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classes. The means^ foV the three administrations are 3.23, 3.16, and 

3.40. From these it may be. concluded that the participants rated the 

seminars as being similar to seminars and class discussions from other 

courses. Participant comments from the IFQ indicated that -the opportunity 

to see and hear experts in the field was valuable. 

"Very good to hav^e a'uthors of materials and educators in 
career education answer questions from stijdents." 

"Provides enthusiasm— contact with various experts, not j 
othenvise available." 

However, some participants felt that more cUssroom teachers should have^ 

been included on the panel . 

"Time is monitored well . - How about getting some classroom 
teachers, theyVe experienced in the reali ty of t\^e situation 
and are the REAL EXPERTS." 

Participants also felt a lack of personal, contact a/id that they were not 

getting direct answers to their questions. 

"Panel appeared to be experts in answering questions to the 
moderator. We did not really feel that they were talking 
to u£ personally or answering questions that we needed to 
have answered. " 

' "Real live, in-person seminars can be of better quality. 

"Seminar panel should make as concise, specific answers to 
student questions as possible and then enlarge on the 
explanation if necessary." 

"I had the feeling they covered only areas they had prepared-. 
. Individual quesJfe-ions seemed to be disregarded." 

"Lack of humanegs. Can't ask direct questions or disagree." 

"I would like to react right away to speakers." • 

The last seminar (#4) was considered the best by the participants . \ * 

"Last seminar was best because the two panelists gave 
straight-forward answers. They left out the educational 
'jargon*." 

■ ' ''^ . ^ 



"Good selection of questions in providing a broad range of 
problems which were helpful," 

"The seminars became progressively better. Seminar 4 was very 
worthwhile." 

The site coordinators, on the Summative Report Form (SR), also 
felt that the seminars improved with time, and that questions were not 
answered directly. 

"Seminar was excellent; very informative, and it was nice to 
see format working for all sites in this area." 

"Third and fourth seminars best received and most beneficial. 
Selection of panel members made the difference. Moderator 
diq excellent job^'of keeping seminars moving. Suggest one- 
hour seminars insteadxof 45-minute seminars," 

"Concentrate on classroom teachers as guests." 

"The seminars started poorly, but improved continually. The 
responses to questions should be short and brief and to the 
point. Many times panel members talked around the^ answers. 
The moderator should be conscious of the time. taken in 
response to (liuestions. Some of the time wa's taken defending 
a position and this should not be the purpose of the seminars. 
It is difficult to poll questions prior to and during the 
seminars, therefore, a plan should be developecT. " 

- "With four seminars, if is difficult to generaTize. They gpt 
much.bettcr by w3. The teachers 'felt that #3 addressed their 
questions, and it^held in with' the video and ancillary 
activities." 

"Students were unhappy because panelists did not respond to 
them dli;ectl.y,'- rather talked among themselves." 

.•"Speakers generally good /and interesting." 

"The scmtnars just did not make it with the students. They 
seemed restless and uninvolved with few exceptions. The 
seminars lacked the fincss and quality of commercial TV 
interview programs. We should consider moving, closer toward 
professional personnel." 

The consulting faculty members rated the seminar|;^as sometimes 
excellent (average rating 4.24). Their tfomments from the SR indicated a 
lack of interaction aod insufficient time spent on career education in 

• ■ . * 

■ ■ * • 

rural areas. 
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^'At timgs too general." 

"No real dialogue. Needs to be more interaction and discussion 
bet^en and among the panel members." 

"I feel that more small town and rural area ca^-eer^ducation 
programs should have been, discussed, since thdt majority of 
teachers in class work in such schools. Seminars could be 
longer." < 

In general, it may be concluded that the seminars'were broadcast 

at appropriate times in the course sequence, were of high quality and 

that the participants had ample opportunity to ask questions. However, 

the participants felt that the questions asked were not important and 

that. the value of the information obtained was not high. However, the 

quality and usefulness of the seminars increased from the first seminar 

to the last. The final seminar (#4) was regarded as being very worthwhile 

and the participants felt that useful information was discussed. 

Reactions to Evaluation Materials ^ . 

The general reaction to the evaluation design by the site r 

coordinator and consulting faculty was that it was comprehensive and 

well organized, but that' too many observations were taken on too many 

different forms. The participants understood the need for evaluation,. 

but after a while they tended te respond to the instruments without much 

thought about their replies. The site coordinators' comments follo^: 

"The volume of evaluation forms seemed heavy, but the students 
never responded with excess^criticism tqj|:he opportunity. 
The purpose was well servedt" ■■h\ 

"Vary the format. Many answered without much thought after 
the fourth week." • ' ^ 

'"Teachers recognize the need for these forms, but could do 
• • without them. Generally their attitude has been excellent." 
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"Forms flowed freely.* Perhaps more random sampling would 
result in less data contamination, I/m a great advocate of 
evaluation, feeling it*s a vital part of the instructional 
development process. In this course, however, there were 
so many forms, that I believe some people were overwhelmed. 
Confusion persisted in the 1 - 5; D - A scales." 

J ^ "There was an excessive amount of additional paper work 
' the students greatly disliked. Also, ins^tead of 'the paper 

being wasted why^ not give each person one set of all 

questionnaires for the entire course." ^ 

"The form$ were excellent, but the students definitely got 
. tired of filling them out, and I feel that there were too 
many forms to be filled out - some of them were repetitious." • 

^ "Too many forms, some questions on the forms were not 
applicable to the situations in question. Evaluation should 
be tied to a common definitive scale with identifiable 
standards (e.g. quality of video quality of compared to what?)" 

"Unanimous agreement of participants that there was far too \ 
much evaluation. Some resentment at having the same forms f 
for each small event of the day evaluated over ana over. ^ ^ 
I believe the constant repetition .blinded some of the group 
to the fact that the evaluation forms were well constructed 
and were really .good. " ^ 

The consulting faculty rated the evaluation forms as bping 
acceptable (average rating 3.25). They did feel that there were too 
many fcrmc. 

"Comprehensive. " 

"Too many, too often." ^ 

"Students felt that these were highly repetitious, hence 
they became bored and tended to lose interest." 

"Is it risally necessary to have quite so many forms to 
* . • evaluate this program?" 

In conclusion, the evaluation design was too comprehensive. The 
number and frequency of forms filled out by the participants needs to 
have been reduced. Certain forms (e.g., QTVR and UFCA) could be filled 
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out by the site coordinator since they dealt generally with the observation 
of picture and sound quality. The use of sampling schemes so that only ^ 
a few participants filled out; forms would spread the task out and make it 
less objectionable. 

Reactions to Unit Tests i / 

At the beginning of each class session the participants were 
given short unit tests. These were multiple choice' t^'sts of 10 to 12 
■Jtems that sampled the content from the last week's video programs "and 
laboratory activities. They did not count "towards the particiaants ' grades 
For a discussion of the purpose and development of the unit tesK see 



AESP Technical Report #4 (Bramble et al, 1974, pp. 5-9). .The unit tests 
were used as an evaluation tool to measure unit learning and as an 
instructional aid. The participants were able to check the^^ answers 
after they' completed their tests and disciiss the answers with other course 
'participants. For a discussion of ^participant performance on the unit 
tests see AESP Technical Report #9 (Marion, Bramble, and Ausness, 1975). 

Item 9 on the IFQ asked the participant to compare the unit tests 
to instructor made tests in other graduate classes they had taken. The 
means for the three administrations of the IFQ were 3.72, 3.15, 3.48. 
From this it may be concluded that the participants attitudes were . 
generally positive towards the unit tests. Participant comments regarding 
the unit tests from the' IFQ indicated that while they liked the feedback 
on their answers, they felt that often the questions were either not 
related to the televised programs they saw or were so subjective^at 
several answers appear to be correct. ^ 
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"I like having immediate feedback with reasoning. I miss 
having a teacher to argue with when I disagree with the right 
answer. Sometimes conflict over^test questions, etc., causes 
the course offerfj^ig to be clarifijed for other students as well 
as myself." 

"Tests appear to be better learning instruments than most 
tests." 

"Tests are notion materials covered by the video." 
< 

"Tests are poorly constructed. Too many opinions." 

"Do not relate to TV programs--not consistent or show 
individual work in own communities." 

"Too subjective. I find Questions with practically every 
test question and response." 

"So many of the unit test questions covered materials we 
had not yet covered." 

"Most could have been answered without the' TV presentations, 
Many of us disagreed with your answers." ^ 

"The tests were very outstanding and coirreided with the 



course. " 



"Overall, the tests were well constructed and provided the 
student with a wealth of information. The quick feedback 
was very helpful." 

"Many answers it seemed to me were-ambiguous in nature." 

"The unit tests were comprehensive and provided a good 
* review." 

"About average. Many questions, however, were very poorly 

stated." ^ I 

The Vite coordinators felt that the unit tests were a good idea, 

that they generated discussfih, and were a good review. However, they 

felt tliat the ambiguity of the questions caused great participant 

frustration. 
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"The unit tests served as a valuable reinforcement for- the 
progr^." 

"Unit tests served well in providing review. Students received 
the opportunity to review and check their answers with 
enthusiasm." 

"No comment---caused discussion in class which is a good factor." 
"Tests were good follow-up activity." - 

"This is a good method of evaluation, but students were concerned 
over many, qyestions and the desired responses." 

"Students recognized instructional value, but grew weary of the 
repetitiveness." . . 

"Here I think there is a need for careful ^rewording of some 
.questions. Teachers became very frustrated' by the use. of y 
negatives, doubl-e negatives and specific answers to questions 
which they considered quite general." • 

"This was an. area of greatest frustration. Students could rjot 
see tie-in or relationship between urvit- tests and lectures, 
activities, etc. So often contained information that had not 
been covered or could not be reported on form provided." 

"A couple of times tests seem to require subjective answers." 

"There was some disagreement about the correct responses." 

The consulting faculty rated the. unit tests as being excellent at 

times\wrfi^ rating 4.0). Their comments are similar to the site 

coordinator 

'*At times, some unit test questions w%re not closely related 
to lectures."" if 

. 7 "Unit tests seemed well devised." 

"Fairly comprehensive. At times these tended to cause student 
anxiety." 

^ In conclusion, the iinit tests were seen as helpful as a reinforce 
ment tool", but they suffered from being ambiguous and not closely related 
to the televised programs. * 
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CONCLUSIONS 

. The following is a summary of conclusions regarding participant 
attitudes toward CEE course activities. 

- Videotaped(5i^graims in the first half of the course were 
rated as better than those in the latter half of the course. 
Revision of some of the later videotapes is advisable. 

^ ■ 

- Overall, the videotaped programs were rated. as .slightly 
better than typical campus lectures. 

/ ■ ■ ■ V " 

- The immediate feedback nature of the four-channel audio ^ 
review was the best liked feature of that activity. 

- The students generally liked the audioVeview; however, some 
questions were felt to be ambiguous, subjective and not . 
related to the vide6 programs. 

- The laboratory activities thought to be most interesting 
activities were organised around small group projects and 
encouraged discussion and interaction among the *partici pants. 

- The information systems needed more careful explanation 
and more time devoted to them in order for the participants 
to be able to appreciate such resources. 

54 
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- The on-site reference materials were felt to be adequate and^ 

. very useful . ^ ^ 

- The live> interactive seminars were rated as being similar 
in quality to on-carapus seminars; however, they were seen as 
somewhat impersonal . 

- The opportunity jbo see.aihd hear experts in career education 
was regarded as a strong point of the seminars. 

- The value of the information received from the seminars was- 
regarded initially as somewhat low; however, with subsequent 
seminars, their value and utility was felt to increase. 

- The evaluation design tncluded too many forms. Revision of 
the design to include fewer administrations of fewer forms 
is suggested. 
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APPENDIX A 



Item A 

Televised Program Titles and Descriptions of Material Covered . 

PROGRAM 1 - THE CONCEPT OF CAREER EDUCATION V ' 

' This introductory program is designed to demonstrate the. need for 
- career education and to offer a "basic tenets" definition of it. 
In so doing, it touches upon both educational and general social 
needs, recent history of career education, several prominent 
definitions and the overall philosophy of career education. 

PROGRAM 2 - A COMPLETE CAREER EDUCATION PROGRAM ^ 

In this program selected examples of career education oriented^ 
classroom sessions demonstrate the actual implementation of this 
concept throughout the school system (kindergarten through 12th 
gra^iej^d beyond). The specificity of these examples enhance the 
working defin^*tion of career education from the previous program 
and as an overview, introduce items to be treated later in the 
course (e.g. child development and career development theories 
.and sequencing). This presentation should leeve the student 
with the basics of the total scope of career Education from 
awareness to exploration to preparation and beyond high school. 



PROGRAM 3 - JOB CLUSTERING: A TOOL FOR CAREER EDUCATION 

This presentation demonstrates the need to order and sequence 
the vast world of work for students. Clustering is introduced 
and defined as a major tool for the teacher to use in this 
effort. Although several types of available clustering systems J 
are mentioned, the major portion of the program is devoted to 
offering the audience a single clustering system to use as a 
guide to career education in their own classroom. 

PROGRAM 4 - INTEGRATING CAREER EDUCATION INT(|J>)E CURRICULUM 

This program gives the detailed steps needed for integrating ^a 
single career education experience into the academic curriculum. 
As a "how to" primer it shows the teacher how to establish career 
education goals and plans irf language arts. While the program 
offers a set of examples appropriate to an ideal situation, the 
student receives a formalized integration process which he/she 
can easily adapt to individual classrooms. 
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PROGRAM 5 - TOTAL CURRICULUM INTEGRATION 

This program reinforces and builds upon that int^ormation arid 
those efforts discussed in Program 4 by expanding the sample 
integration scheme into the academic su^'ect areas of science, 
math, and the social sciencess. In doing so, it offers a set 
' of examples that represent total curriculum integration in an 
ideal situation, and gives the teacher a view of integration 
in a complete curriculum unit. With the information developed 
in Programs 4 and 5, the student has a sound, practical , base 
for integrating career educatipn in the classroom. 



PROGRAM 6 - THE COLLECTION AND UTILIZATION OF INSTRUCTIONAL MATERIALS 

This presentation focuses on various types of resource materials 
available to the classroom teacher for use in infusing career 
education into the classroom. Concerning commerical materials 
available, the program offers guidelines on how to assess and 
utilize film strips, study kits. *Too, the program presents 
a host of ideas and resources the teacher can use in creating 
his/her own materials, for career education. 



PROGRAM 7 - COMMUNITY RESOURCES 

This program asserts the importance of community involvement 
as both a valid input to educational change and as an 
extremely fruitful resource area. It focuses on the actual 
classroom use of the community as a resource and the importance 
of the teacher's role as a liaison between the community and^ 
the student. • / 



PROGRAM 8 - IMPLEMENTATION STRATEGY (for the School System) 

# 

This presentation describes the roles that must be assumed by ^ 
everyone in the school in planning and implementing a total 
career education program. Beyond the individual classroom 
teacher, this would include curriculum task force committees, 
guidance counselors and administration personnel. 



PROGRAM 9 - ATTITUDES ABOUT CHANGE 

This program acquaints the teacher with the attitudes, both^pro 
and con, that he or she must, at some time, deal with. As 
career education" necessitates a form of educational change. 
It must invite and contend with the feelings, attitudes, and 
convictions of everyone—from the teacher in the next classroom 
to the community at large. It is the purpose of this program 
to display many of these points of view, and thus, aid each 
student in formulating his or her^own ideas. 
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PROGRAM 10 - DEALING WITH EDUCATIONAL CHANGE 



Building on information, from previous programs, this program 
demonstrates the necessity of community involvement in 
effectively dealing with concerns about educational change. 



PROGRAM 11 -SPECIAL INTERESTS AND CAREER EDUCATION 

Related to attitudes, this program centers on the needs of 
special concern groups such as labor, management, minority 
groups, and exceptional children. These are areas that must 
be considered in any plan for educational change. 



PROGRAM 12 - THE REWARDS OF A COMPREHENSIVE CAREER EDUCATION PROGRAM 

This presentation illustrates the implications of career 
education for the ultimate consumer, the student. 
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Seminar Participants in Career Education in the Elementary School 



Elizabeth Alday: 

Robert Arceneaux: 

Gene Bottoms: 

Marie Burrow: 
Gino Carlotti: 
Owen Collins: 

Gary DuBois: 

Henry Durant: 

Brian Fluck: 

William D. Hathaway: 
Ken Hoyt : 

Phillip Laguidice: 
Darryl Laramore: 

Sidney Marl and: 
Dan Nasman: 

Jonathan Osborn: 

EaM Smith: 
Grant Venn; 



Elementary School Coordinator, Falcnor 
County Schools, New York State 

Superintendent, Adult ajid Career Education, 
Lafayette, Louisiana 

Director, Division of Program and Staff Develop- 
ment for the Georgia State Department of Education 

Director of'Career Education, St, Louis, Missouri 

Vocational Counsel/JrC Erie, Pennsylvania 

Career Education Proje6t Director, Hazard, 
Kentucky^ 

DTmftor of Alternative. School , Ca^sadagau, 
New York 

Director of Career Education, McKeesport, 
Pennsylvania 

Director of Vocational Education, Endsburg, 
Pennsylvania 

Senator, Maine 

Director, U^S, Office of Career Education 

District Superintendent, BOCES, New York State 

•Supervisor of Vocational Guidance, Montgomery 
^County Public Schools, Rockville; Maryland 

HI 

Piresident, CCEB * ^ ^ 

Career Education Project Coordinator, San Diego, 
California ' . 

Director, Comprehensive Care and Placement, 
Morristown, .yermont / 

Superintendent 

Professor of Education, Georgia State University. 



60 



/ Item B 

Summary of Materials Covered in Laboratory Activities 



Session 1 



PROGRAM 1 - The Concepts of Career Education 
4-Channel Audio 

PROGRAM 2 - A Complete Career Education Program z • 

4-Channel Audio ^ 

Activities and Materials Needed 

1. Life-ropfes Activity Description 
r Old magazines , ^ 

- 4" X 6" index cards ' , 

- Crayons or felt pens 

- Ball of string 

- Scissors . 

2. Laramore, Darryl , "The Classroom Teacher in Career Education", 
NASSP- Bulletin , (activity) ^ , 

3. Procedure for "Brainstorming^" about Career Development 
Assignments 

Read: Marland, Sidney, "Career Edutation - More Than a Name" 
* Marland; Sidney, "The Need for Career Education" \ 

Marland, Sidney, "Career Education Now" 
Keller, Louise, Career Education In-Service Training Guirfe* 



Session 2 



PROGRAM 3 - Job Clustering 

4-Channel Audio ^ 

PROGRAM 4 - Integrating Career Education into the Curriculum 
4-Channel Audio ^ « 

Activities and Materials Needed • 

VI- Review the summary of USplE clustering system 

2. Correlate the local re/ources with USOE clusters--local 
telephone directories l 

,*This'guide was provided to each stuS^t 
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Correspondence for information activity 

** An Analysis of 15 occupational clusters as identified 

by the U,S, Office of Education" 
**Dictionary of Occupational Titles, Vol. 1^ 
♦^Occupational Outlook Handbook 
♦♦Encyclopedia of Careers, Vol. 1-2 

Stationary ^ - 

Envelopes 

AIM/ARM Activities Description 

- Definition and Procedures Manual 

- Indexes and Abstracts 

- Microfiche 

- Microfiche Readers 



Assignments 

Read simple unit based on the hisalth cluster. 
Review questions ^to be polled for week #3. 



Session 3' 



PROGRAM 5 - Total Curriculum Integration 
4-Channel Audio 

Seminar 1 - Curriculum Integration, Alternate Idea? 
Special Problems 
4-Channel Audio . 

# 

Activities and Materials Needed 

1. Read Class Project Description 

2. Add-on Unit Sample and Procedure, Plan A 

3. Infused Unit Sample and Procedure, Plan B 

4. Career Education Media Procedure 

5. Retrieval Systems Search Descriptions 
-AIM/ARM Training Manual 

-CBRU Reference Manual 

Assignments ^ ' 



Begin research on your Career Education Learning Package 
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Session 4 

PROGRAM 6 - Collections and Utilizatipn of Instructional Materials 
4-Channel Audio 

Program l - utilizing the Fominunity*"as a Resource 
4-Channel Audio 

Activities and Materials Needed 

'' I. "Hands-On" Activity Procedure 

1. "Yellow Pages of the Working World" Procedure 

Assignments . 

1. Develop "hands-on" activity 

2. Begin assignment on "Yellow Pages of the Worjcing World" 

3. On-going research arid development of Career Education Learning Packag 

For Your Information 

Free and Inexpensjyi Learning Materials , George Peabody College for 
\ Teachers, Nashville, Tenn, 1970 

Educators' Guide> to Free Films , 1970-71 ed. Educators Progress 

Service, Box 497, Randolph, Wisconsin, 53956, 
Educators Guide to Free Filmstrips ^ 1970 ed. 
Educators Guide to Free Materials , 1970 ed. 
Educators Guide to Free Science Materials , 1970 ed. 
Educators Guide to Free Tapes, Scrips, and Transcriptions , 1970 ed. 



Session 5 



PROGRAM 8 - Implementation Strategy for Career Education 
4-Channel Audio ^ \ 

PROGRAM 9 - Attitudes About Change ^ 
4-Channel Audio 

Activities and Malr^fHgls Needed 

1, Learning Center Procedure and Activity 

2, Self Made Persons Procedure and Activity 

- Article, "Conviviality and Fate Control" 

- Article, "Tell Me Teacher" 



Assignments , 

y 

On-going reserach and development of Career Education Learning Package 
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Session 6 



PROGRAM 10 - Dealing with Educational^ Change 

4-Channel Audio - . 

Seminar 2 - Problems in Program Planning 
4-Channel Audio 

Activities and Materials Needed 

1 . Hand i n Yellow Pages of the Working WorlJ 

2. Educational Change: Procedure for Part I, "Permanence" 

- Four lairge brown envelopes marked, "Educational Change: 
Part I" (one envelope per group) 

(Note to Site Coordinator: These materials are in your 
packet but are not numbered because they are nbt contained 
in the student's packets. They are contained in the brown 
envelopes listed above) 

3. Educational Change: Procedure for Part U, "Stability Versus 
Change^' 

4. ^ Educational Change: Procedure for Part III, "Process" 

5. Educational Change: Procedure for PartMV, "Changed Objects" 

r 

Assignments 

1: Complete pre-program questionnaire; due: week 7, August 6, 1974 

2. Read article and supplementary questions regarding the roles 
of sjtudents and communities in planning curriculum change 

3. -'On-going research and development of Career Education Learning 

Package 



Session 7 - 

IT ' / 

I 

PROGRAM IT - Career Education and Special Interest Groups 
4-Chahnel Audio . 

Semina.ifv3 - Assessing and dealing with Local Special Concerns 
4-Channel Audio 
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Activities and Materials Needed ^ ' 

Jl. Stereotyping Ijistructions ^ 
- Manila envelope entitled "Stereotyped Activity" 

2. Stereotyping— Whole Group Discussion Topics ' 

Assignments 

... ■ ' <' * 1 

1. Gol lection Data on Stereotyping; due: week 8, August 20, 1974 

2. Read "The Problems with Stereotypes" 

Session 8 

PROGRAM The Rewards of a Comprehensive Career Education Program 
Seminar 4 - Summary Discussion with National Career Education Authorities 
Activities • ' 



1. Discuss Week 7 assignment; "Collecting Data on Stereotyping" 

2. Read summary article: "Career Education: A Report." by Sidney 
Marl and * 

3. Turn in Career Education Learning Packages 
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APPENDIX B 

Appendix B contains tables of item means for all of the instruments 
reported on in the text. In each table, individual" items and a paraphrasing 
of the item wordings are included. On the actual instruments some of the 
items were phrased nega-tively. In the tables the phrasing of ^^the items has 
been changed and the means have been reversed to allow for the correct 
i"nterpretat1on of the ratings. In the columns of these tables are the CEE 
programs. In the body of the tables are the ilenTmeans. These were obtained 
by averaging over the number of individuals who responded to each item. 
For tables A," D and F statistical tests were run to determine which program. 
* means for each item were significantly higher or slower than the other program 

means. For Tables A and D contrasts ^^ere computed that compared one mean 
against the combined mean for the remaining means on that item. For Table F, 
Tukey - HSD tests on successive pairs of means were run for each item. 




65 



ERIC 



66 



CO 

cx: 



o 



«J I- 

I— o 

to 

^ CD 



(d 0) m 

> 
o 



o 



CL 



00 



i 



00 



00 
00 



o 
o 



o 



ID 



00 



ID 



ID 



ID 



CNJ 



ID 



o 



o 



o 



ID 



CO 



ID 

ro 



O 
ro 



ro 



ro 



CNJ 
CNJ 



ro 
ro 



LD 



1 



ID 



CNJ 
ID 



CNJ 



o 



ro 



00 



00 
ID 



VD 
VD 



00 
ID 



ro 



VD 
ID 



ro 



00 
ID 



O 



CO 



o 



o 

00 



VD 



ro 



VD 

ro 



*- 

ID 
CNJ 



CNJ 
00 



ID 



CO 



ro 



ID 



00 
00 



00 
00 



o 

CO 



VD 
O 



VD 

O 



CNJ 

CNJ 



ro 



00 

VD 



00 



00 

o 



00 

ro 



CNJ 



CO 



00 
o 



CNJ 



ro 



ro 



VD 
O 



00 
O 



CNJ 



VD 
CNJ 



O 

ro 



ro 
ro 



CNJ 
CNJ 



CO 



Vo 



o 



o 



ro 



in 
00 



o 
00 



GO 

00 



00 

VD 



* ■ 

ID 



00 



ro 



00 
o 



VD 



O 
O 



C7> 
00 



00 

VD 



o 

VD 



ID 
ID 



CNJ 

in 



VD 
O 



ID 

o 



* ■ 
00 

CNJ 



VD 
O 















c 






t 










r> 


. 1— 










-a 










o 




c' 






£ 


c 










c 


0) 


o 






O 


(0 






■M 




0) 


x: 


•r~ 






L. 


■M 




c 








■M 


■M 


-a 0) 






(/) 










t5 




C 


0) ^ 






L. 


0) 




O) 








0) 


u 






0) 


IM 




c 




O 


c 


■M 


OJ c 




(0 


tr- 














■M 


> o 






c 


C 


> 


0) 






Q) 


(0 


o 




•o 


r> 






0) 




0) 


0) 




O 4-> 








S" 




(/) 






(/) 








■M 


•o 




1— 






O 




!• 






(0 




o 








Q. 






^ c 




O) 


Q. 










(/) 


$ 




ta 




u 






£• 












o t. 






Q) 




o 


r> 




U 


r> 


'3 


■M -O •*-> 












c u 




o 


u 












2 


U 


o.f- 




■M 


•r~ 




r— <U 






(/) 




(0 






U 




£ 


<4- •«-> 




•o 


£ u 


■M 








r> 






t- -I- ta 








c 


(/) 




> 


u 






I- 4-> 3 


(/) 


c 


u x: 


0) 






1— 


■M 


•o 




0) c cr (0 


u 


O) Q. - 


■M 


■M 


c 




(/) 




o 












o o 


c 


C 


O 


u 


«a -a "O x> 




S:. U C 


o 


to 


u ss 


o 




o. 


£ cC 




•J 




o 








ro 




ID 


VD 




00 




o 



t/i 



o 
o 



Q. t 

i§ 

O) X 
1.0)0 

■M O 

0)0) (d c 

U I- C 4-> 
0)^0 

~ (/) 

(d O) 
0).*IO -o 



o 
o 



0> 

U 
O) 



5 , 



O) c 
• t5 O 



_ ta 
ta 4-> 



(O c o 

s: 32: 



U 0) 
O c/) 
Q. O) 
£ U 

•P- CL 



•M O) > 

O X I- 

C O 

JZ «*- 

C C/) o 

4-> O) O C/) t/) 

(O 4-> (d O) 

0) C 3 t/) I— 

I— 0) I— U 3 3 

Q. I/) Q. 4-> x: <«- 

£ O) E (/) O) 

O t. f- C C CO 

u a. t/) ^ o) 3 



ERIC 



7G 




67 



Its § 

> 
o 



o 



CQ 



O 

a. 

Its 

u 
a. 



00 



E 



CO 
CO 



CVJ 



in 



CO 



CVJ 



o 



ro 



CVJ 



4c 



V£) 



00 
CVJ 



CVJ 

o 



CO 



00 
00 



CVJ 



ro 



o 



CVJ' 

ro 



CVJ 



o 
ro 



CVJ 



00 

.ro 



CVJ 



00 

o 



ro 



CVJ 



ro 
ro 



CVJ 

ro 



ro 



CM 



CVJ 



•ID 



CVJ 



00 

ro 



cn 

CO 



ro 

CO 



00 



00 



ro 

00. 



ro 



CO 
CO 



o 
o 



o 
o 



LD 



00 



o 



LD 



ro 



o 



CVJ 



CO 



CVJ 

00 



in 



LD 



O 
LD 



o 



* . 
o 



LD 



ro 



o 

CVJ 



CVJ 



o 
ro 



CVJ 



ro 



CVJ 



LD 
O 



VO 
O 



CVJ 



ro 



00 



CO 



CO 



o 



00 



00 

o 



at 
o 



o 



ID 

ro 



vo 



CVJ 
00 



o 
vo 



CVJ 



LD 
VO 



VO 

o 



00 

o 



ro 



ro 



ro 
cn 



LD 

cn 



ro 



ro 



CVJ 



cn 



o 



o 



cn 
ro 



CO 

o 



CVJ 

o 



vo 
o 



CVJ 

o 



vo ro 



ro 
vo 



cn 

LD 



cn 
cn 



LD 

o 



Its 
E 



o o 
OJ <u 
u •»-> 

U OJ JO 
O U 3 
U 3 I/) 
•!-> 

-O U V|- 

OJ CU O 

•I- * 

OJ > c 
O H- 
U U 
OJ VH* Its 
Q- O O- 



CO cn 





















o 






Its 


>» 
















OJ 


o 






4-1 








OJ 


Its 




Its 


u 


4-1 


•fj 






c 


u 








OJ 




a> 


OJ 










OJ 


Its 








cx 




cx 


c 


o 












o 




E 


t/1 




t/1 


c 


4-> 


OJ 










o 












Its 




> 


Its 






u 


•!-> 




t/1 


4-> 






E 




o 






C 










O 




O 






u 


u 








4-> 




<!-> 


c 




c 


a^ 






OJ 








O 




O 








c 


4-> 


4-> 


4-> 






o 


c 




C 


■o 




■o 




O 


O 


Its 
















OJ 






c 


c 


— E 




OJ 




t/1 




t/1 


■q 


c -o 


c 






Its 




4-1 


Its 




fO 




o 




OJ 


t/1 




•1- 0) 




4-> 


u 








u 


4-> 


L. 


u 


Its 




1/) 




Its 


o 








o 


O 


O 


t/1 








E 












c 


4-> 


OJ 






4-> 


O) 




u 


Its 




Its 


U 


o 




OJ 


E 


Its o 


4-> 


4-> 






U 






E 




c 


u 


Its 


E 4-> 


C 


U 


U 






u 


U 




U 


o 




u 




OJ 


OJ 






OJ 


4-> 


Its 




u 


4-> 




in 


•r-> 


t/1 






4-> 


t/1 




to 




U 


o 


U ^ 


OJ JQ 


.c 


(IS 




Its 


C 


c 


c 


c 




u 










z -o £ 














E -J 


cxco 


o> 


O 




r—" 


CVJ 




ro 






LD 


vo 








CVJ 




CM 


CVJ 




CVJ 




CVJ 


CVJ 


CVJ 




CVJ 



u 

OJ 



a o 

OJ J" 



OJ 

>• 

OJ 



OJ 

> 
Q 

OJ 



o 



Its 

OJ 
E 



OJ 



OJ 

o> 

Its 
u 

OJ 

> 



E 
o 



OJ 

> 

OJ 



LD 

o 
o 



OJ 
OJ 



Its 
u 



01 

OJ 

u 

c 
o 
u 



I 
I 

OJ 
OJ 

u 



C ' 

o 



Its ^ 
OJ LD 

EO 



OJ 

SZ t/1 

O 



OJ 



o 
o. 
I 

in 



OJ 



ERIC 



tf 6 



68 



o 
o 









u. 
»— « 








FO 








z 




o 


00 


»— 1 






LU * 


<j: 


-J . 


»— 1 


CQ 


5» 


<c 


UJ 


1 — 


o 




o 








2 








z 




<i: 








LO 




O 




z 








CO 




z 




LU 




!£: 




s: 

LU 











O) » 

> 
o 



E 
u 

e 

D. 



CSi 



LD 

..,1 

<>0 



CVJ 



r— in 
in 00 

• • CSJ 
m 



O vo 
in o> r- 

. • CVJ 

m 



CO 
CD 



CD 



vDOVD ^r^vD novo o>oo»— 
o t— vD 00 cr> 00 I— LT) cr> o 

..OJ ..CSi ••CSi -'CSi 



CSi 



o in o 
^ o 

. • CSi 

m I— 



in 



CSi GO o 

VD o 

. . CSi 

m 



00 O o> 
»— cn 



LT) r— cr> 
CSJ CO 



00 o en 
CSi <j» 



i^csir^ «^i^oo CO VD cr> vd O 
csicsir>. incot^ ooo^t^ vDCT>un 



VD 00 CO 

r-r o in 



r— CO LD CO r— 

^ GO in r— in 



' r— CO I— 



GO "d* vo in hN, in 

id- GO f— v£) cr» I— 

. .CSi . . CSi 

CO CO 



csii^^ r— ^ f— 00 VD VD <:J- cn CO VD cn VD O O 

IT) o cr» r^GO»— J — 00 »— cn oo csj o oo vd oo cn 

. ..CSi .'CSi ..»— ..r— 

CO I — CO ^ CO CO r— CO 



CSJ VD O 

00 cr> 



c • 



c • 

Oi . z 

IE CO 



c . 

OJ . ; 
S to 



c . 

to T3 

o) • : 
ie: to 



c . 

Q) . : 
£ to 



c . 

to "O 

OJ . ; 
S to 



c « 

OJ . : 
s: to 



c: . 

OJ . : 
z: to 



c . 



■o 








C 




a> 








to 




to 
















Z3 


O 


4-> 




U 




0) 


o 










OJ 


■o 




0) 


fd 


u 




<a 


-a 


Q. 


to 


E 


u 


O 


o> 


O to 






<a 


C to 




O t/) 


o 






4-> r— 




<a o 


■o 


u 


0) 




' u 


Q.4-» 


<a 


OJ to 


Q. 


J- 3 


E 


Q.T3 


o 




o 


E 








u 


<d 


.o> u 


u 


O 0) 


OI 


u jc 


o 


D. 4-» 


u 


1 O 


D. 






u c 


> 












CSJ 



to 

fO to 









u o 


to 






<u -«-» 


0) 


>* 




<«-» o 


IM 






03 3 


hj 


o 




E J- 










3 to 


OS 




O t/l 


cr w 






4-» C 










to y . 


2 


to 


■o ■ 


to to 


to 


<D 


OJ OJ 


to c 




to 


U. <M 


r— fO 




t/) 


to as 


O 


o 


to 


Q. 3 








E -O 


O JC 




U 


o to 


4-» •*-» 


■o 




u &- 




0) 


0) 




■o w- 


u 




Ul 


0) o 




Id 


f— u 


u 




3 


Id 0) 


to c 




■o 


t- ^ 


Q. O 


o 


to 


U 4-» 


E 


o 


u. 


OJ o 


O t/i 




o> 




O to 


Ul 




rt3 >> 


3 


0) 


u 


E JQ 


o o 




0) 




•r- to 


4-» 


JC 


OJ OJ 


■o 






O > 


3 -O 


> 


o 


c u 








0) OJ 


to 




c 


L. to 




O 




OJ OJ 










c ^ 




to 


OJ 


C ' 




. u c 




u 




o 


-«= 


to 




0) 


o 2 






4-» -a 


1 o 




> 


^ 0) 


U r— 




•r— 


to O 


3 f— 


o 




1 to 


o o 


c 


O 


C f— 






fd 


o a. 


CO 






in 









OJ 




in 




















Id 




1 


a. 






3 


to 


1 








"O 




OJ 


OJ 


O 




Id 


Ul 


JC 






U' 


OJ 




o o 


■o 


to 










OJ 


c 




OJ 








o 


Q) 


•o 


a. 




Id 


- 


JC 


Id 


OJ 


<U to 


a. 


to 


4-» 


E 


u 


U 3 


E 


Ul 






u 


Id 


O 


.3 




u. 


to 


d. to 


u 


o 


o 


; o 


. c 


E <L) 




i/i 






3 


O Ul 


to 






u 




u u 




■o 


"O 


3 


II 


3 


to 




OJ 






Ul O 


c 


Ul 












to 


Id 


U) 




Id 


E 


Id 


a. 


C Ul 




•r- OJ 


OJ 




E 








to 


u 


O 


to 


OJ Id 






o 


O Ul . 




-M 3 


OJ 


■o 




4-» Id 


Id 


itJ "O 


> 


c 


to 




o 






Id 




•o o . 


Ul 


E 2 






c 


OJ 




to CD 


o 


to 


OJ 


U. Q) 


4-» 


'E. 


Id 




E 


to -M 


: U. 






to 


c 


ol Id 




4-» OJ 


OJ 




OI 


E 3 




to JC 








O "O 




>*•»-» 


c 


E ■ 


to 


o Id 




Ul O 




0) 


Ul 








to 




to cn 


4-> 


f— to 


■o 








C 


Id Ul 


0) 


0) 




. to u 


•f 


> Id 


to 




U to 


OJ OJ 


o 


OJ -r- C 




Id 


O OJ 


4J JC 


a. 


0) 


> 


3 


5 Ul 




in 


U 0) -o 




OJ to 


-M O 


4-» 4-» 3 




Id 


E to 






0) Id -M 


0) 


u 


O f— 


C C 




E to 






3: u 




<u 






















o 








00 




z 



o> 
c 

"O ■ 
c 
Id 



o 

II 



ERIC 




69 



CO 

o 



4;j 



o 



CO 

H- O 

CO 
CD 



u 

o- 

o 

u 

a. 

•o 

O) 
Q. 

<a 

u 
a. 



00 



in 



CM 



CM 
CM 



o 
o 



CTi 

o 



CM 
CM 



UD 



CTi 
CM 



CO 



CM 
UD 



CTi 



CO 



CM 
UD 



in 



UD 
UD 



CM 
LO 



CM 

tn 



o 



CM 
IT) 



CO 
IT) 



CO 
CM 



CM 

o 



o. 



IT) 
IT) 



in 



CO 
CO 



n 

UD 



CM 

in 



CO 



IT) 
CO 



CO 



IT) 
CO 



CM 



CO 
CO 



CO 







4-) 








fd 












> 




o» 




0) 




c 




u 












4-> 


> 


0 


c 


10 








U ' 






u 


<D 






0) 


Q. 


4-1 


< 




0 


c 








0) 






'U 


4-> 




0) 


0 


4-> 


c 








c 


4-> 


TJ 




«a 


c 








0) 




0) 




E 




4-J 


1 


cx 




C 


u 




•!-> 








(/) 




0 


cr 


C . 


c 




0) 







o 

CM 



CO 



UD 
UD 



CO 



o 



o 



cn 



CO 

yCO 



cn 

CM 



CM 



cn 

CO 



UD 
IT) 



CO 



CM 
CO 



CM 
CO 



CM 
CO 



CO 



CO 



CO 



.CO 

cn 



UD 
UD 



UD 



IT) 

cn 



CM 



CO 

o 



CO 
CO 



UD 



CM 



CO 
UD 



UD 



in 



CM 
O 



CO 
CM 



CO 
O 



UD 

cn 



CO 



o 

CO 



o 



o 



u 



2 







4-» 








0) 






0) 


l/> 






E 


TJ 


3: 






«a 


(/) 


0) 


4-» 


0) 


.- c 


4-» 




JC 


fd 


u 


«a 






0 




c 


4-» 


•!-» 




0 


u 


V) 






0) 












u 




'a! 


C 


0) 


Q. 


(/) 


3 










(/) 


0 


0 


(/) 


c 


4-» 


4-» 


«a 


«d 










0) 


0) 




<u 


E 


E 




c 






^? 


0 


4-» 


4-» 












>» 


4-> 


4-> 


(d 




C 


C 


3 


c 






cr 


0 












u 


0) 








u 














M- 


0 






3 


> 


3: 




CO 


CM 


CO 




in 









E 


I-. 4-1 










a. 


i (/) 












1 










3 


\ M- . 










cr 












0) 


! 0 






TJ 


(/) 




1 0 






0) 


3 










4-) 




'S 








U 


0 


c 




>> 




<u 


4-» 


c 












Id 


0) . 


Li 




'5 


TJ 


.x: 




Id 


M- 


(/) 


U 


u 


, */> 


0) 


0 




Id 


1 








u 


JZ 


^■ 


' 4J 


u 


4-» 


0) 






0 




3 




4-» 




C 




U 


(/) 


0 


c 








c 


C 




TJ 


0 


4-» 


*d 








cx 


0 




4-» 


3 


TJ 


(/) 


. C 


TJ 


C 












0) 


TJ 


U 


u 


u 


> 


E 


0) 


0) 


0) 


0) 




a. . 


>» 




* ^ 








0 


Id 


Id 


t/> 


u 


3 




0) 


<u 


c 


0) 


cr 


c 


cx 


cx 


< 


oc 


Ul 


Ul 


c/i 




UD 




CO 


cn 


CD 





CX 

o 



o 

TJ 



Id 



u 



Id- 
> 



Id 
2 



O 

o 





u 




C7> 




TJ 


•0 0 0) 




C 




C 


C 0) 2 








Id 


Id TJ 


JC 


4-» 




4-» 


4J f- t/» 


O) 


I/) 




i/> 


> c 


3 


0) 




u 


1- 0 


0 


u 




0) 


0) c 


u 


0) 




TJ • 


TJ-»- 4J 


0 


4-» 




c 


C C/> 


JC 


c 




3 


3TJ <D 
0) 3 


4-» 




(/) 


0) 


0) 4-» cr 


0) 




4-» 


E 


E c 


u 




U 




0) 0 


0) 


0) 


0) 


TJ 


TJ t/> *^ 








0) 










CX 


CX U (/) 


i/> - 


(/) 


3 




p-> CX c 


c 


c 


C/1 


'5 


0) 0 


0 


0 




JZ 








M- 




f~ 4-» 


4-» 


4-» 


0 


4-» 


4-» Id Id 


Id 


Id 




C 


C'l- c 


c 


c . 


U 


0) 


0) u Id 


Id 


Id 




4-» 


4-» 0) f— 








c 


C 4-» CX 


'a. 


CX 


E 


0 


0 Id X 


K 


X 


3 


0 


0 E L«J 


Ul 


m 




CO 


^ LO 


UD 







4-) 








Id 








TJ 




4-» 




Id 








4-» 












1 




CM 




r— 






imJt 


E ^ 




0) 




4-> 




*^ ■ 






/- 


0) 




4-« 




Id 




^ 




I/) 




>t 




Id 












Id 




TJ 








3 








U 




>) 




0? 




x: 




4_) 




to 




3 




JC - 










0) 




0) 




^ 


Id 






Id 


0 








4-1 




Id 


C7) 


u 


c 


0) 


0 


CX 


t« 


0 


4-» 




%J\ 


4-1 






It 


c 






LO 


\h 




Id 


1 




1 


+J 


(L) 


c 




0) 




E 




CX 


Id 




to 


3 




cr 


TJ 


0) 






>) 












c 




0 


.0) 


. 


•r- 


4-» 


> 


to 


0) 




u 


n 


0 








pn 




Id • 




4-» 




c 


Id 


0 0) 




4-1 


to 


(/) c 




4-» 0 


4-» 


CX u 


u- 










0 0) 






—I 


> 




TJ <U 


4-» 


id.i- 


C 


0) 


•r— 


u 0 


0 




0. 


l/> TJ 


1 


4-1 3 


LO 


c Id 








TJ -C 




3 4J 


(U 


4-1 -1- 


4-> 


00 5 









EMC 



70 



CO 



o 
o 



CO 

o 
I- 



Overall 
Item 

ncan 


3.21 


3.91 


3.92 


3.43 


4.36 


4.28 


4.26 


3.54 


3.69 


4.05 


4.01 


3.46 


3.85 




CvJ 
r— 


3.47* 


CM 


3.92 


3.35 


4.38 


4.41 


%.37 


3.66 


3.75 


4.42* 


4.29* 


3.57 


3.95 






3.54* 


4.13* 


3.95 


3.44 


4.45 


4.32 


4.35 


3.62 


CO 
CO 


« 


4.40* 


3.65 


3.95 


>> 


o 


2.87* 


4.02 


3.57* 


3.31 


4.47 


4.16 


4.20 


3.10* 


3.33* 


4.14 


3.94 


3.39 


3.86 




Activi 


o3 
00 


,2.75* 


3.75 


3.84 


3.73* 


4.53 


4.22 


4.24 


3.29* 


3.36* 


4.10 


CSJ 

o 


3.33 


3.76 


oratory 


r^. 


. ; 

00' 
CNJ 

CO 


3.74 


3.99 


3.35 


4.15 


4.34 


4.24 


3.45 


3.75 


.3.47* 


3.66* 


3.52 


3.83 


Lab 


in 


3.08 


3.62* 


4.09 


3.61 


4.29 


4.32 


4.23 


4.86* 


4.00* 


3.78* 


3.81 


3.41 


3.71 




<^ 

•Q 

CO 


2.89* 


3.32* 


3.73 


3.11* 


4.02* 


3.95* 


3.86*. 


3.68 


^3.70 


3.40* 


3.69 


3.25 


3.50* 




CSJ 
•0 


3.67* 


4.27* 


bo 


3,38 


4.44 


4.39 


4.44* 


3.61 


3.:86^ 


4.31* 


4.09 


3.51 


4.10 



c 
o 



to 
u 

to 

Q. 
O) 

u 

Q. 



CO 

c 
o 



c 
o 



o 



a; 



g 



c 



to 
cr 

OJ t/) 
"O CD to 
fO <L) 



c 

C 

o 
o 



<L) > t~ 
-O > > 
•f- +J f- 

> O -M 4-» 

o ra o o 

-L. to to 

CL JD , ^ 

o»r— u ra 

<L) O <L) O 
-O OJ i— 

1- JZ to u to 

> 4-> U U 

0 0)0 

OJ U J3 u ^ 

^ O ra O) ra 

J- M 1 5 -J 



OJ 

u 

o 

O t/) Q. 

OJ f— 
<U r— CD 

O) O 
2 O) t/> 

C/) S 
OJ > 

T- C 

4-» C O 
f- rO 

> ^ +J 

4J O 

O OJ 
ra c/) <u 

>» c 

o to 

r— rO •!- C 
3 U <M OJ 

M- O O 
O) ^ ra 3 
I/) ra U <l-i 
3 -J O-U^ 



a> OJ 



3 



3 
r— 



OJ 
ra 

3 . 

cr 

OJ 



(/) OJ 

U) ' O) > 

u > u 

o •»- o 



to c 



o. o 

_ 4J O 

O fO o 

u 

O O) 

to 

Ul I— Ul 



u 

o 
o 











^' 




















0 










4-» 


>' 








to 


to 








L. 


o> 








0 




<J 






4-) 














4-) 

O 1/) 










rO f— 


<U 


OJ 


to 




L. rO 






JZ 






4-) 


4-) 






L. 














C 




^ -M 


<U 








4-1 ra 


4-) 










<U 


c 


OJ 




OJ 








OJ 


OJ OJ 


Q. 






o 


t/j x: 


E 






c 


4-) 


o 


0 


3 




3 


o 


4-) 






O 










>* o 


>* 


<U 


> 


OJ 






£ 












X 


4-> C 


'3 




ra 


OJ 








2 






(/) 





c 

^ o ^ 

to I 03 
f— ' I/) rr- 

OJ c <u 
j:: ra x: 



4J to 

to <u 
o o 
o 

3 
Q. t/) 
Q. 

to *-* 



c 
o 



o 
o 



to 
rO 

• 3B 

c 
o 

to 
I/) 

(/) <L) 



3P 4-i ^ 
•I- rO 
<U > r— 

O) 4-) O) 
^ O ^ 



















u 








C3I 




0 








<u 




w 




<u 








to 
















H 




<U 




4-> 




ra 












N 








C 




ra 




CJ> 




L. 




0 











ERIC 



0 



■71 ■ . ' 



to <D (O 

> 
o 



>» 

•r- 
> 



U 

<: 

>> 
s- 
o 

Id 
s- 
o 



o 



I 

Q 



CD 



en 

00 



0) 



CVJ 



-le 



-ic 
CO 



CO 

o 



in 



CO 



o 



CVJ 



CO 



cn 



-le 
CO 



LO 

o 



OJ 
00 



cn 



CVJ 

00 



CO 
C\J 



CVJ 

cn 



O 



o 



o 



in 

00 



00 



00 



■le 
C<Q 
CVJ . 



00 
CO 



-it 

00 



CVJ 

cn 



CVJ 

o 



m 

CVJ 



00 
CO 



cn 



CVJ 

o 



00 
CO 



CVJ 



CO 

in 



o 



cn 

CO 



o 



CO 

o 



cn 



CVJ 

in 



vo 



cn 



cn 
o 



in 



cn 



cn 



CVJ 

o 



CO 

00 



00 



■IC 

cn 

CO 



CO 



■IC • 
CVJ 



vo 

vo 



■IC 
CO 

00 



■IC 

vo 

00 



CVJ 



in 
o 

CVJ 



cn 



o 



CVJ 
CVJ 



00 



CO 
CVJ 
CVJ 











in 










to 












■o 


















in 


■o 








0) 










•r- 










4-> 


u 








•r— 










>. 






*5 














+J 


1/) 




0) 






to 




E 




ra 






ro 










U 
















to 




c 






•r- 




o 










•r— 




0) 


0) 




4-> 






4-> 




ro 






to 


m 


C 






B 




to 


LO 










<D 


o 






o. 


•r- 




u 




X 










<D 


•r- 


LO 


B 






> 


o 




1—* 


0) 


•r— 




o 






4-> 




o 


0) 


fO 


U 




4^ 




3' 


fO 


o. 






CT 






<M 








O 


c 


■o 


fO 








< 




1— 






in 




ID 



o 
u 



0) 

cr 
■o 



■o 

cr 



C 5v <D 

1- f— 



J- 3 

fO o 





LO 






t/) 






<D 


0) 




0) 




10 




f— 


u 








>* 




+J 


u 




0) 


■o 


o 




•r- 


fO 




:s 


c 


••-> 




r— 










c 




•r— 






LO 




0) 


LO 


U 






0) 








to 


o> 




*r- 


E 


<D 


u 








+J 






0) 




O 




•r— 


■o 


o 


••-> 


E 






> 


0) 


E 




o 














LO O 


>» 






1— <D 


LO 


" 00 


l/) 


LO 




U 


0) <(-> 


to 




ro LO 


to 


LO 




^ -M 






1— </) 


0) 






O) 




. O 








-O 


-O -O 








(/) 


•r- 








' u 










f— o 




O 0) 


1"" 




0) 




o 












0) 


0) -o 


<D -O B 










^ -1- 




•r- 3 




t—i 


B H- 


H- > H- 


> 2 


00 


cn 








CVJ 










CVJ 


CVJ 


CVJ 





(J l—l .p. ^ 



tern 
























o 








■ 












<u 




cz 




$»* 
























• ' 




TO 


s- 










o 






>» 


<L} 










c 




o 


(L) 


s- 


5^ 


+J 


fu 


I/I 


rti 


II 


_ z_ 

••~ 




*^ 


in 


_ 


1 


O 


1 








0) 






■ 






cn 


Si 






•to 








■o 




>> 




r— 


o 






c 




o 




s- 






c 


LO 


Q) 




U 


II 


0) 
















"O in 




o 


0) 


>> • 


r— 


r— 


ra 


4-> LO 


u 


Of- 


LO 


ra 




U f— 








> 




•r- <D 




C r- 




o> 


-J 






</) 


+J 




c 


LO r— 


•r— 




o 






C 0) 


1 


fO > 


in 


o> o 












0) ^ 




^ -♦-> 






o 


* 





72 



TABLE E 



\ MEAN RATINGS ON ISUSQ: CEE COURSE 
(N=198) 



Item ■ Mean 

1. The Computer Based Resource Guide training package adequately 
explained the -use, of this information system'. • 3.36 

2. The ERIC/AIM/ARM, RIE, CUE training package adequately ^ 
explained the use of this information system. 3.02 

3. I feel that the information request form for the Computer 

Based Resource Guide information system was clear in its format. 3.31 

4. I feel that the inforjnation request form fdr-the ERIC/AIM/ARM, 

RIE, CUE information system was clear in its format. ^ 3.15 

5. I feel that it did not take too long to receive information 

from the Computer Based /Resource Guide system. ^ 2.87 



6) / I feel that it did not take too long to receive information 
^ from the ERIC/AIM/ARM, RIE, CUE system. ' 2.90 




7. The Computer Based Resource Guide information search provided 
me with. the information I wanted. ^ 3.'y2 

8. The%RlC/AIM/ARM, RIE, CUE information search provided me . 

" with the information I wanted. • 3.16 

9. The Computer Resource Guide information system ^gave me more 

' information than I expected. " .3.06 

10. The ERIC/AIM/ARM, RIE, CUE information system gave Ae more 
information than I expected. 3-05 

11. The Computer Based Resource Guide information system was 

easy to use. ■^•^^ 

12. The ERIC/AIM/ARM, RIE, CUE information system was easy 
to use. _ ' - 

13. The information received from the Computer Based Resource^ 

Guide information system was easy to interpret. 3.18 

14. The information received from the ERIC/AIM/ARM, RIE, CUE 
information system was easy to interpret. 3.14 



2.80 
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J 

"1^f«t^ E ~ -CONTINUED 



Item - * -Mean 

— : ■ : 

15. The Computer Based Resource Guide information system 

provided me with useful information - ^ 3.34 

16. The ERIC/AIM/ARM. RIE, CUE information system provided me i. 
with useful information. * 3.35 

17^ The Computer Based Resource Guide information system is well 

worth the time and effort it took to use it. 3.32 



^SP The- ERIC/AIM/ ARM, RIE, PIJE information system is well worth 

the .time and effort it took to use it. , 3.21 

19. I did not receive conflicting information from the different 

information systems. 3.4f7 
\ . ' ' * ' 
'20. If the Computer Based Resource Guide information were 

available ^o me, in my' school system, I would use it. 3.80 

"21. If the ERIC/AIM/A1^M7 RIE. CUE inforinattxjrr'-system were 

available to me, in my school system, I would use it. , 3.74 ; 

22. . I fee^^l that the Computer Based Resource Guide information 

system is extremely ^eneficial to me as a teacher. • 3.55 v 

23. I feel that the ERIC/AIM?ARM, RIE. CUE information system - , , 

is extremely beneficial to me as a teacher. , ' 3*45 . 

24. I would recommend the Computer Based Resource ^uide ^. " \ 
information system to my fallow teachers. ' ^ - 

* ' - " , ■ °* ' . 

25. I would recomrnend the ERIC/AIM/ARM, RIE, CUE information 

/ system to my fellow teacihers. ^ , - 3.48 

^ ■ -^r-^ 

Note: 5-point Likert scale « 1 = strongly, disa^ee-"^-- ^= strongly agree 
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